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This  report  considers  object  identification  and  manipulation  using  silhouette  moments. 
The  fundamental  theory  behind  moments  for  image  analysis  is  presented,  and  comparative 
object  identification  results  are  given  for  silhouette  moments  and  a  number  of  other  object 
description  techniques.  Also  discussed  are  the  techniques  of  aspect  ratio  normalization,  and 
variance  balancing,  which  greatly  enhance  the  classification  success  Both  clean  and  noisy 
synthetic  date  are  considered,  with  silhouette  moments  the  meet  successful  and  economical 
technique  in  both  cases.  A  further  consideration  for  noisy  data  is  the  reduction  of  the  noise 
level;  to  accomplish  this,  multi-image  averaging  is  eiaminsd  comparatively  in  the  moment  and 
image  domain.  It  is  shown  that  averaging  in  the  moment  domain  is  particularly  effective  in 
situations  where  the  location  of  an  objKt  within  a  scene  is  uncertain.  The  optimization  of  the 
elements  contained  in  the  feature  vectors  is  also  of  importance  to  achieve  accurate  and  efficient 
object  identification.  Feature  vectors  composed  of  subsets  of  complete  silhouette  moment  sets 
are  examined,  and  it  is  found  that  odd  order  moments  in  general,  and  order  two  moments,  are 
critical  to  clssrification  success.  A  final  consideration  is  the  inverse  transform  from  moment 
domain  to  image  domain.  An  iterative  technique  to  accomplish  this  is  presented,  along  with 
actual  results. 
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1.  Introduction 

The  suitability  of  the  method  of  moments  for  object  identification  has  been  demonstrated 
in  the  literature  repeatedly.  The  most  fundamental  moment  based  approach  is  to  use  only  the 
silhouette  of  an  object  to  produce  silhouette  moments.  This  report  will  consider  a  number  of 
issues  related  to  object  recognition  using  silhouette  moment  representations: 

The  first  section  contains  an  of  the  fundamentals  of  moment  theory  and 

object  normalisation.  A  comparison  of  classification  results  for  the  techniques  of  silhouette 
momenta;  moment  invariants,  Fourier  descriptors,  and  several  other  methods  are  presented. 
This  discussion  provides  the  basis  for  the  consideration  of  moments  as  an  object  identification 
tool.  A  system  for  evaluation  of  experimental  object  identification  succem  is  also  presented, 
and  then  further  refined  in  section  4. 

The  comparison  experiments  presented  in  section  1  were  funded  by  the  National  Science 
Foundation  and  the  Army.  They  are  presented  in  more  detail  in  [5l  which  is  also  included  as 
appendix  A  These  results  were  included  to  maintain  the  completeness  and  continuity  of  this 
report. 

Given  the  possibility  of  obtaining  multiple  images  of  a  noisy  object,  an  examination  of 
noise  reduction  by  image  averaging  in  the  moment  domain  is  of  interest.  In  section  3  a  tech¬ 
nique  for  averaging  image  sequences  in  the  moment  domain  is  presented,  and  a  comparison  of 
averaging  in  the  greylevel  and  moment  domains  is  made.  In  cases  where  the  object’s  precise 
position  within  the  image  is  not  known  with  certainty  from  frame  to  frame,  it  will  be  shown 
that  moment  averaging  can  be  very  effective  for  noise  reduction. 

As  an  extension  of  the  object  identification  work,  it  is  of  interest  to  know  the  relative 
importance  of  different  moment  values  to  object  recognition.  In  section  4  an  examination  is 
made  of  object  identification  success  using  various  subsets  of  the  standard  complete  moment 
set  This  analysis  is  performed  with  various  types  of  moment  normalization,  and  using  clean 
and  noisy  objects. 


Section  5  presents  an  inverse  moment  transformation  to  convert  from  a  set  of  silhouette 
moments  back  to  a  silhouette  image.  The  performance  of  this  technique  is  discussed,  and  a 
number  of  sample  reconstructions  are  presented. 


2.  Fundamental  Moment  Theory  and  Experimentation 

The  properties  of  moments  and  Fourier  descriptors  have  been  examined  by  the  use  of  an 
experiment  involving  six  airplane  shapes  viewed  at  random  angles  in  three  dimensions. 
Fourier  descriptors  as  used  by  Wallace  and  Wintz  [1]  have  been  compared  with  our  own 
scheme  [2]  for  normalized  momenta  Moment  invariants  as  used  by  Durian  i  et  aL  [Jj.  have 
also  been  considered.  Many  different  normalized  moment  forma  have  been  proposed  [2] 
including  Legendre  moments  and  variants  of  moment  invariants  [4]  In  this  paper  the  perfor¬ 
mances  of  several  normalization  techniques  were  compared. 

Most  of  the  previous  work  with  moments,  such  as  that  by  Dudani  et  al  [3].  has  centered 
on  moment  invariants;  we  have  concentrated  our  efforts  on  normalized  conventional  moments 
which  we  consider  to  be  teas  sensitive  to  noise.  Section  22  of  this  report  outlines  the  theory  of 
conventional  moment  normalization.  In  section  22  a  new  normalization  technique,  aspect 
ratio  normalization,  is  described.  We  have  compared  the  performance  of  moments  with 
Fourier  descriptors;  section  2A  briefly  outlines  the  method  we  used  for  computing  Fourier 
descriptors:  In  section  23  details  of  our  classification  procedures  are  given.  The  results  for 
experiments  are  given  in  section  2 £. 

The  first  six  airplane  experiment  was  conducted  by  Dudani  et.  aL[l]  using  moment 
invariants  as  the  feature  vectors.  A  library  of  feature  vectors  for  different  views  of  each  air¬ 
craft  were  constructed  and  then  an  unknown  was  identified  by  the  best  match  into  these 
libraries:  The  input  image  data  was  obtained  with  a  TV  camera  viewing  a  plastic  model  of 
each  airplane.  Wallace  and  Wintz  [2]  conducted  a  similar  type  of  experiment  to  investigate 
the  properties  of  Fourier  descriptors  as  feature  vectors.  In  this  case  the  airplane  images,  for 
both  libraries  and  unknowns,  were  generated  by  the  computer  from  a  3-dimensional  graphics 
model.  This  procedure  is  more  convenient  than  Durian i*»  in  that  data  from  any  angle  or  reso¬ 
lution  can  be  computed  independent  of  the  imaging  system  defects. 

The  experiments  described  in  this  section  were  based  on  the  software  used  by  Wallace 
and  Wintz.  The  same  six  airplanes  were  used  and  also  the  same  method  was  used  to  generate 


the  Fourier  descriptor  feature  vectors  However,  most  other  parameters  and  the  feature  vector 
clarification  scheme  was  significantly  different. 

In  our  experiments  the  minimum  Euclidean  distance  in  the  feature  space  of  the  unpro¬ 
cessed  feature  vectors  was  used  to  determine  distances.  A  feature  vector  weighting  scheme 
was  also  investigated  which  set  the  expected  value  for  each  element  of  the  total  library  to 
one.  This  produced  higher  classification  success  rates  for  moment  feature  vectors. 

The  comparison  experiments  presented  in  this  section  were  funded  by  the  National  Sci¬ 
ence  Foundation  and  the  Army,  and  are  presented  here  for  completeness.  A  more  detailed  dis¬ 
cussion  of  these  experiments  is  contained  in  [5]  which  is  included  as  Appendix  A. 

2.1.  Hie  Six  Airplane  Experiment 

A  standardized  six  airplane  classification  task  was  used  for  all  experiments.  It  is  loosely 
based  on  an  experiment  designed  and  developed  by  Wallace  and  Wintz  [lj.  Their  experiment 
was,  in  turn,  baaed  on  the  experiment  conducted  by  Dudani  etaL  [3J. 

In  the  six  airplane  experiment  the  six  airplanes  were  described  by  a  short  list  of  parame¬ 
ters.  These  parameters  are  used  to  generate  a  representation  of  the  three  dimensional  surface 
of  an  airplane  by  a  set  of  three  and  four  sided  polygons.  A  library  of  feature  vector  sets  of 
two  dimensional  views  for  each  airplane  was  generated.  For  the  experiments  in  this  section, 
library  samples  were  usually  taken  over  a  uniform  grid  of  viewing  angles.  Each  library 
entry  was  normalized  with  respect  to  size,  location,  and  in-plane  rotation. 

A  set  of  random  views  of  the  six  airplanes  was  used  to  generate  a  test  set  of  feature  vec¬ 
tors.  Each  teat  view  was  matched  by  means  of  nearest  Euclidean  neighbor  in  feature  space  to 
its  closest  entry  in  the  library.  The  class  of  this  entry  was  then  used  to  identify  the  test  air¬ 
plane.  The  performance  of  the  shape  analysis  scheme  was  indicated  by  the  number  of  correct 
clarifications. 

In  our  tests  we  increased  the  library  size  from  143  views  covering  one  hemisphere,  as 
used  by  Wallace  and  Wintz,  to  500  equally  spaced  views  covering  the  whole  sphere  of  pari- 


ble  viewing  directions:  All  the  results  were  computed  with  500  library  views  for  each  of  the 
six  airplanes  and  the  standard  50  unknowns  as  used  by  Wallace  and  Wintz.  All  image  resolu¬ 
tions  were  128  x  128  for  both  libraries  and  unknowns. 

22.  Moment  Feature  Vectors 

The  conventional  definition  of  the  two-dimensional  moment  of  order  (pfq)  of  a  function 
fCxjr)is 

00  00 

Mhs  I  I  x'y'fOcjldx  dy 

— oo  — 

P4  =  Q,1A  “•  (2.1 ) 

If  f(x,y)  is  piecewise  continuous  and  has  nonzero  values  only  in  the  finite  part  of  the  x-y 

plane,  then  moments  of  all  orders  exist  Furthermore,  the  double  moment  sequence  {Mn }  is 

uniquely  determined  by  fCxjOt  and  conversely  fOty)  is  uniquely  determined  by  [Mn }  [6]. 

A  set  of  moment  values  may  be  used  to  represent  a  segment  of  an  image.  Operations 
such  as  rotation,  translation  and  scale  change  may  more  easily  be  achieved  in  the  moment 
domain  than  the  original  pixel  domain.  Furthermore,  a  truncated  set  of  moments  may  offer  a 
more  convenient  and  economical  representation  of  the  essential  shape  characteristics  of  an 
image  segment  than  a  pixel  based  representation. 

There  has  been  sporadic  interest  in  the  use  of  image  segment  moments  for  shape  analysis: 
One  of  the  earliest  relevant  theoretic  studies  of  moments  was  presented  by  M-K  Hu  in  1962 
[6J.  He  described  how  fundamental  transformations  such  as  translation,  rotation,  and  scale 
change  could  be  achieved  with  the  moment  image  representation.  Rotation  invariance  proved 
to  be  the  most  difficult  to  achieve.  Hu  proposed  two  methods  for  rotation  invariance;  aligning 
the  moments  with  the  principle  axis  and  computing  rotation  invariant  combinations  of 
moments  called  moment  invariants. 

A  second  important  theoretical  work  on  moments  was  R.  M.  Teague’s  1980  paper  [4J. 
Teague  introduced  the  concept  of  orthogonal  moment  sets  and  showed  how  the  concept  of 
Hu’s  moment  invariants  may  be  extended.  He  also  showed  how  an  approximate  inverse 


moment  transform  could  be  defined.  Hu  defined  seven  moment  invariants  of  order  three  and 
leas.  He  demonstrated  the  method  of  invariants  for  a  character  recognition  application  in 
which  two  moment  invariants  of  order  two  were  used  as  a  feature  vector. 

Recent  work  [7]  has  shown  that  both  the  moments  of  the  binary  silhouette  and  the 
grey-valued  image  segment  may  be  used  together  for  classification.  Furthermore,  the  two 
Himynmnrmi  moments  may  be  used  to  obtain  moments  of  projections  through  the  image  seg¬ 
ment  which  may,  in  turn,  be  used  in  classification  schemes. 

Transformations  of  Conventional  Moments 
The  operations  of  scale  change,  translation  and  rotation  of  an  image  segment  are  easily 
defined  in  terms  of  moments 

(a)  Scale  change 

The  moments  of  fO^y)  after  a  scale  change  by  a  factor  X  are  defined  by 

M‘„  -  f  f  x'y*  fix/ Ky/tidx  dy  (23) 

— oo  — oo 

this  may  be  expressed  in  terms  of  the  original  moments  of  fCx,y)  by 

M„  =  X2+'+*  M„  (2.3) 

(b)  Translation 

The  moments  of  ffa,y)  translated  by  an  amount  (a,b)  are  defined  by 

Mn  ■  f  f  (x+ay  (y+bt  f(x&)dxdy  ( 2A ) 

this  may  be  expressed  in  terms  of  the  original  moments  of  f(x,y)  by 

-  t  t  fel  fe]  a'~r  (2-5) 

(c)  Rotation 

The  moments  of  f(x,y)  after  a  rotation  by  an  angle  6  about  the  origin  are  defined 
by 


Mn  ■  f  f  Gc  cos0  +  ysindy(ycosO-xsind)»  f(x,y)dx  dy 


(2.6) 


this  may  be  expressed  in  terms  of  the  original  moments  of  f(x,y)  by 


m„  -  t  t  fel  fe]  (.cos  ey-r+*  (sm  oy+r~*  m ,+,-r-„+,  (2.7) 

The  rotation  of  an  image  segment  about  an  arbitrary  point  may  be  achieved  in 
three  steps.  First  translate  the  moments  so  that  the  point  of  rotation  is  at  the  origin 
using  (2^),  then  rotate  the  moments  using  (2.7)  and,  finally  translate  the  moments 
such  that  the  point  of  rotation  is  returned  to  its  original  position. 

(d)  Reflection 

A  reflection  about  the  y  axis  results  in  a  change  of  sign  of  all  moments  which 
depend  upon  an  odd  power  of  y,  Le, 

M  'n  =  /  £ *'  y1  f(*  -y ) dx  dy  a8) 

=  (-1>MW 

A  reflection  about  an  arbitrary  axis  may  be  achieved  in  three  steps.  First,  the 
moments  are  rotated  so  that  the  reflection  axis  is  aligned  with  the  y  axis.  Second, 
the  moments  are  reflected  about  they  axis  by  using  the  transform  specified  by  (2.8). 
Finally,  the  reflected  moments  must  be  rotated  to  restore  the  reflection  axis  to  its 
original  orientation. 

2.2.2.  Normalized  Moment  Sets 

For  image  analysis  purposes  an  image  segment  is  represented  by  a  truncated  set  of 
moments.  From  inspection  of  equations  (2.3),  (2J),  (2.7)  and  (2.8)  in  the  previous  section  we 
see  that  a  transformed  moment  value  does  not  depend  upon  any  moment  of  a  higher  order.  A 
compute  moment  set  (CMS)  of  order  n  is  defined  to  be  a  set  of  all  moments  of  order  n  and 
lower.  Operations  which  correspond  to  translation,  rotation  and  scale  change  are  closed  with 
respect  to  a  CMS  of  f(x,y). 

A  CMS  of  order  n  may  be  conveniently  expressed  in  a  triangular  matrix  form  as  shown 
below: 


I 


Af  00  iw  01  Aa  02  ’  *  *  A/  On 

Af  10 

M„o 

A  CMS  contains  (n+lXn+2)/2  elements. 

Scale  normalization  may  be  achieved  by  setting  Af  oo  to  1.  For  a  binary  image  or  a  grey 
level  image  with  a  mean  grey  level  of  1  this  corresponds  to  standardizing  the  area  of  the 
image  segment  to  1.  The  scale  factor  to  achieve  this  normalization  is 

A*  *  1/  (2.9) 

A  slightly  different  scheme  is  used  by  Dudani  et  aL  The  radius  of  gyration  is  normalized  to  1 

by  using  the  following  scale  factor 

A*  —  1/  V  Mo2  +  (2.10) 

Where  M02  and  Mzo  an  central  moments  as  defined  by  equation  (2.13).  It  is  expected  that  the 

results  of  the  two  schemes  would  be  very  similar. 

Translation  normalization  is  usually  achieved  by  translating  the  origin  to  the  center  of 
gravity  of  the  image;  moments  with  their  origin  at  the  center  of  gravity  of  the  image  are 
called  central  moments.  The  position  of  the  center  of  gravity  (jc  ,y  )  may  be  determined  from 
non  central  moments  by 

*  —Mi  o/  M  oo  (2.11) 

y  —  M  oi/  M  oo  (2.12) 

The  central  moments  can  then  be  computed  from  (2.10)  substituting  a  -  — x  and  b  =  y 

Le, 

=  t  t  fc|  fc)  (HFV-WJf,,  (2.13) 

p*0t*0  f 

Two  methods  of  rotation  normalization  have  been  proposed  by  Hu  [6l  In  the  first 
method  the  principal  axis  of  the  image  are  determined  and  the  moments  are  transformed  to 
align  with  these  axes.  The  main  problem  with  this  method  is  to  uniquely  determine  the  prin¬ 
cipal  axis.  The  second  method  is  to  generate  simple  combinations  of  moments  called  moment 


V 


9 


invariants  which  Hu  derived  from  algebraic  invariants.  In  this  case  it  is  not  necessary  to 
determine  the  principal  axis  but  it  is  difficult  to  define  further  operations  on  sets  of  moment 
invariants: 

The  principal  axis  moments  are  obtained  by  rotating  the  axis  of  the  central  moments 
until  fin  is  zero.  The  angle  9,  from  the  original  axis  to  the  principal  axis  is  defined  by 

tan  29  =  — ~ —  (2.14) 

”  M02 

The  angle  theta  obtained  with  (2.14)  may  be  with  respect  to  either  the  major  principal 
axis  or  the  minor  principal  axis.  One  way  to  determine  a  unique  orientation  of  the  principal 
axis  is  to  set  the  additional  constraints  that  fi'x  >Mo2  and  fix  >0.  The  correct  rotation  angle 
will  be  9  +  nir/  2  where  n  is  chosen  to  satisfy  those  constraints.  Problems  may  occur  when 
an  image  is  n-fold  symmetric  since  there  are  multiple  possible  sets  of  principle  avis. 

For  some  applications  reflection  normalization  may  be  useful.  In  this  case  an  image  seg¬ 
ment  and  its  mirror  image  would  be  represented  by  the  enw  normalized  moment  set.  For 
moments  with  the  above  rotation  normalization  a  reflected  image  would  be  reflected  about  the 
y  axis  when  compared  with  a  non-reflected  image.  Therefore,  an  additional  constraint  such  as 
fix  >0  may  be  used  to  ensure  reflection  normalization.  If  after  rotation  normalization 
fi‘M  <0  then  a  reflection  transformation  as  specified  by  (2.8)  would  be  necessary. 

224.  Standard  Momenta 

A  set  of  standard  momenta  is  a  CMS  which  has  been  normalized  with  respect  to  scale, 
translation,  rotation  and  optionally  reflection.  The  low  order  standard  moments  have  the  fol¬ 
lowing  values: 

M oo  a  1  {area  normalized  to  1} 

M 10  *  0  {central  moments,  taken  about 
M  oi  “  0  the  center  of  gravity) 

M  u  *  0  {rotation  normalization;  moments  are 
taken  about  the  principal  axis) 


V'Vv 


For  rotation  normalization  we  also  have 
Af  20  ^  Af  Q2 
Af  jo  >  0 

If  reflection  normalization  is  selected 
AT 03  >0 

The  standard  moment  representation  of  a  segment  is  very  convenient  for  shape  analysis 
and  may  be  compared  directly  with  other  standard  moment  sets  for  shape  similarity. 

23.  Aspect  Ratio  Normalization 

A  feature  of  the  standard  moments,  as  described  in  the  previous  section,  is  that  far  blob¬ 
like  objects  the  magnitude  of  the  moments  will  decrease  as  the  order  increases.  The  condition 
for  diminishing  magnitudes  is  that  the  object  be  confined  within  a  2x2  square  centered  at  the 
origin.  Recall  that  Af  oo,  the  object  area,  is  1,  therefore  all  other  moments  will  be  less  than  1. 
If  any  part  of  the  object  extends  beyond  this  square  region,  then  some  moments  will  become 
increasingly  large  and  even  for  low  orders  may  be  much  larger  than  1.  A  significant  number 
of  the  airplane  library  images  extend  beyond  the  2x2  square. 

In  order  to  improve  the  behavior  of  feature  vectors;  an  Aspect  ratio  normalization  was 
developed.  This  is  a  projective  transform  of  an  image  of  the  object  which  converts  the  ellip¬ 
soid  of  inertia  of  the  object  to  a  circle,  Le*  M  x  —  Af o»  while  maintaining  —  1.  There 
are  still  shapes  which  would  extend  beyond  the  2x2  square  even  after  this  normalization; 
however,  all  of  the  airplane  images  were  contained  in  this  square. 

A  change  in  scale  by  a  factor  of  8  in  the  x  direction  and  y  in  the  y  direction  is  given  by: 

M„  -  81+'  M„  (2.15) 

For  aspect  normalization  the  area  remains  1,  Le, 

Af  oo  ■  Af  oo-l  (2.16) 

From  (2.15) 


%  - -4  »-v  -  T  -"3  ' 
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For  aspect  normalization 


M„  -  6yM„ 

8  m  1/  y 


From  (2.15) 


W»  ■ 


8V/ »  -  8^3/ <»  (2.17) 

8  »  (A/oa/  A/ jo)^ 

The  aspect  transformation  is  achieved  with  (2.15)  using  8,  the  aspect  ratio  as  rfefinwH  in  (2.17X 
and  y»l/  8. 


This  transformation  is  applied  to  standard  moments.  Far  the  transformed  moments; 

B 

3/  20  *  3/ 02,  therefore  we  discard  one  of  them.  The  aspect  ratio  8  is  an  important  shape 
feature  and  is  used  as  the  first  or  most  significant  feature  element.  Its  value  is  in  the  range 
0<8«1. 

■ 

I 

2  A.  Fourier  Descriptors 

A  common  set  of  features  used  to  recognize  a  silhouette  or  contour  is  the  Fourier  descrip- 
|  tor  of  the  contour  [8l  The  method  used  in  our  experiments  is  fully  described  in  [lj.  A  short 

description  of  the  process  is  included  here. 

Consider  a  closed  contour  C  in  the  complex  plane.  Trace  it  once  in  the  counter-clockwise 
direction  with  uniform  velocity  v,  obtaining  the  complex  function  z(t)  with  parameter  t. 
Choose  v  so  that  the  time  T  required  to  traverse  the  contour  is  2ir.  Traversing  the  contour 
more  than  once  yields  a  periodic  function,  which  may  be  expanded  in  a  convergent  Fourier 
"  series.  We  will  define  a  Fourier  descriptor  of  C  to  be  the  complex  Fourier  series  expansion  of 

z(tX 


*(?)■  T  A(n)«xp(jru) 
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AGO  *  yir/ *(t)*xp(.—jnt)dt 


This  FD  depends  on  both  C  and  the  starting  point  of  z(tX  In  practice,  C  is  taken  from  a  digi¬ 
tized  image,  and  thus  zCt)  is  not  available  as  a  continuous  function.  If  zCk)  is  a  uniformly 
sampled  version  of  z(t)  of  dimension  N,  the  discrete  Fourier  transform  directly  gives  us  the  N 
lowest  frequency  coefficients  AGO. 

The  computation  of  the  FD  is  fairly  straightforward.  The  original  mmpled  contour  is 
assumed  to  be  given  in  the  form  of  an  eight-neighbor  chain  code.  This  chain  code  representa¬ 
tion  is  converted  into  a  sequence  of  z-y  coordinates.  The  piecewise  linear  contour  defined  by 
the  original  chain  code  can  be  smoothed  as  described  in  [l]  and  the  resulting  sequence  of  z-y 
coordinates  is  taken  to  accurately  represent  the  original  contour.  The  length  of  the  contour  is 
computed,  and  the  contour  is  resampled  at  a  spacing  chosen  to  make  the  total  number  of  sam¬ 
ples  a  power  of  twa  The  FD  is  computed  by  simply  taking  the  FFT  of  this  sequence.  Alter¬ 
natively  the  Fourier  coefficients  can  be  calculated  using  a  DPT  approach  which  uses  the  piece- 
wise  linear  nature  of  the  chain  code  to  speed  the  calculation. 

The  frequency  domain  operations  which  affect  the  position,  size,  orientation,  and  starting 
point  of  the  contour  follow  directly  from  properties  of  the  DFT.  Normalization  of  an  unk¬ 
nown  contour  with  respect  to  these  variables  is  required  before  comparison  with  a  library  of 
known  shapes  is  possible.  Let  the  input  FD  be  A(iX  —N/2  +  1  <i  /  2.  Let  the 
coefficient  of  second  greatest  magnitude  be  AGO  (It  K)X  Let  u  and  v  denote  the  phases  of  A(l) 
and  AGO,  respectively. 


1.  Set  A(0)  -  0.  (This  removes  translation  effects). 

2.  Divide  the  A(i)  by  lA(iX  (This  normalizes  the  scale). 

3.  Multiply  the  A(i)  by  txp  fl(i  —k  )u  -Kl— i  )v  ]/  Gt  —  l)X  This  simultaneous  application  of 
the  rotation  and  starting  point  shift  operations  sets  the  phase  of  both  A(l)  and  A(k)  to 
zero.  It  is  not  unique;  there  are  lk-ll-1  other  possible  normalizations  which  also  do  this. 


*•  •**  **.  a/V 
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4.  If  k-2,  w«nw»iir»ty>n  jf  complete.  Otherwise  proceed  to  step  5. 

5.  Compute  the  sum  ^ffeUG)]  I  UetAG)]  I,  and  save.  We  will  use  the  normalization 

i»i 

which  maximizes  this  sum. 

6.  If  step  5  has  been  executed  for  all  Ik-11  different  normalizations,  go  to  step  7.  Otherwise 
multiply  the  A(0  by  txp(.j(i  —  l)2ir/  Ik  —1 1  and  go  to  step  5. 

7.  Hnd  the  largest  ambiguity-resolving  criterion  from  step  5  among  the  Ik-11  values  previ¬ 
ously  saved.  The  associated  normalization  defines  the  NFD. 

The  Fourier  descriptor  thus  obtained  consists  of  coefficients  representing  har¬ 

monics  of  the  contour. 

25.  Classification  Procedures 

Each  airplane,  considered  from  all  possible  viewing  angles;  forms  a  continuous  surface  in 
feature  space.  The  novel  classification  problem  is  to  find  the  closest  airplane  surface  to  an 
unknown  airplane,  which  is  represented  by  a  single  point  in  feature  space.  Classical  feature 
vector  cmirfitinning  procedures,  such  as  the  Eigen  value  transformation  as  used  by  Wallace 
and  Wintz,  are  not  necessarily  appropriate  in  this  case  since  the  within-claas  feature  vector 
variation  (for  all  different  possible  viewing  angles)  is,  in  general,  less  than  the  between-claas 
variation  for  a  given  viewing  angle. 

We  have  used  two  classification  criteria*.  The  first  is  simply  minimum  Euclidean  dis¬ 
tance  in  feature  space.  Both  standard  moments  and  normalized  Fourier  descriptors  have 
feature  elements  which  decrease  in  magnitude  with  order  or  frequency.  Therefore,  more 
weight  is  placed  on  the  lower  order  or  frequency  elements  which  are  expected  to  be  more 
robust  with  respect  to  noise. 

The  second  criteria  is  Euclidean  distance  after  'variance  balancing"  the 

feature  vectors.  Variance  Glancing  u  a  weighting  technique  to  make  the  effect  of  the  feature 
elements  more  equal  The  variance  of  each  feature  element  for  all  feature  vectors  in  the  total 
library  for  all  six  airplanes  is  first  computed.  Then  all  feature  elements  are  weighted  by  the 
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inverse  of  the  standard  deviation  computed  far  the  library.  Therefore,  if  ell  views  of  the  air¬ 
plane  are  equally  likely,  the  expected  variance  of  a  weighted  feature  vector  is  one. 

16.  Experiments  and  Results 

24>.l.  The  Basic  Experiment 

The  following  parameters  were  used  in  the  basic  experiment  reported  in  this  section. 

(1)  The  six  airplanes  were:  a  B57,  an  F104,  an  F105,  a  MiG,  a  Mirage  and  a  Phantom.  These 
were  the  same  planes  used  by  Dudasi  and  by  Wallace  and  Wintz. 

(2)  The  library  views  consisted  of  500  views  uniformly  sampled  over  the  total  sphere  of 
viewing  angles.  In  Dudani’s  experiment  550  views  of  each  airplane  were  taken  at  5 
degree  intervals  in  a  140  by  90  degree  sector.  The  library  views  used  by  Wallace  and 
Wintz  consisted  of  143  entries  covering  one  hemisphere  in  a  11  x  13  grid. 

(3)  The  test  set  consisted  of  the  same  50  random  views  of  each  airplane  for  a  total  set  size  of 
300.  The  viewing  angles  used  were  identical  to  those  of  Wallace  and  Wintz. 

(4)  library  entries  were  computed  from  two-dimensional  views  digitized  on  a  128  x  128 
pixel  matrix.  Test  set  entries  were  also  computed  from  a  128  x  128  pixel  representation. 

Representative  views  of  each  of  the  six  airplanes  with  a  128  x  128  pixel  resolution  are 
shown  in  figure  2.1.  Typical  random  views  of  noisy  versions  of  these  airplanes  are  shown  in 
figure  22. 

2£JU  Noisy  Data  Generation 

Considerable  care  was  taken  in  the  generation  of  the  noisy  data  to  give  realistic  results. 
The  following  operations  were  applied  to  each  clean  test  image. 

1.  The  silhouette  image  was  converted  to  a  grey  level  image  in  which  each  object  point  is 
64  greater  than  the  background. 

2.  A  2  x  2  local  mean  filter  operation  is  performed  which  blurs  the  edges  of  the  grey  level 
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3.  Gaussian  noise  is  added  with  a  mean  of  zero  and  a  standard  deviation  of  30. 

4.  A  second  2x2  local  mean  filter  operation  is  performed. 

5.  A  thresholding  operation  is  performed  at  the  optimal  grey  level  for  the  image  specified 
in  step  L 

6.  A  binary  filtering  algorithm  is  applied  which  selects  only  the  main  connected  region  of 
ones  (object  points)  in  the  image. 

2£3.  Results 

Fourier  descriptors  exhibit  lower  classification  success  than  silhouette  moments  alone  for 
comparably  sized  feature  vectors.  For  small  size  feature  vectors,  variance  balancing  is 
beneficial  but  far  larger  numbers  of  elements  the  results  are  worse.  The  results  for  clean  data 
are  slightly  better  than  those  obtained  by  Wallace  and  Wintz;  this  could  be  due  to  the  denser 
library  used. 

For  conventional  moments  and  aspect  ratio  normalized  moments  variance  balancing  gives 
a  significant  improvement  classification  success.  The  best  results  are  obtained  with  variance 
balanced  aspect  ratio  normalized  moments.  This  performance  it  effectively  achieved  with 
moments  of  order  3;  using  more  moment  values  gives  slight  or  no  improvement.  These  results 
are  consistent  for  both  clean  and  noisy  data  seta 

Figure  23  shows  the  performance  of  the  various  types  of  moments;  and  Fourier  descrip¬ 
tors,  on  clean  data  Mere  extensive  results  are  given  in  [Si  Combining  silhouette  and  boun¬ 
dary  data  did  give  a  slight  improvement  over  the  silhouette  data  alone.  Moments  based  on 
Legendre  polynomials  have  been  propoeed  by  Teague  [4J.  While  the  orthogonal  property 
might  be  expected  to  lead  to  better  feature  vector  representation,  our  results  indicate  that  they 
performed  worse  than  the  silhouette  moments  from  which  they  were  derived.  Boundary 
momenta  by  themselves  performed  much  worse  then  silhouette  momenta 

Also  shown  in  figure  23  are  results  for  moment  invariants  which  are  worse  than  any 
other  technique  tested.  Them  were  computed  in  a  similar  way  to  Dudani  [3]  except  for  the 
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□  boundary  moments 
o  lengendre  silhouette  moments 
A  silhouette  moments 
Y  silhouette  and  boundary  moments 
X  aspect  ratio  silhouette  moments 
O  Fourier  descriptors 
4  silhouette  moment  invariants 
Z  silhouette  and  boundary  moment  invariants 


Figure  2-3 

Graph  showing  results  of  clmiftration  of  clean  data.  All  results  are  variance  balanced. 


first  feature  element  value.  Dudani  assumed  that  the  distance  to  the  object  was  known;  there¬ 
fore  the  absolute  scale  of  the  object  was  also  known  and  is  embodied  in  the  first  feature  vector 
element  In  our  studies  we  have  assumed  that  the  distance  to  the  object  is  not  known.  In  our 
moment  invariants  the  radius  of  gyration  (the  first  feature  element)  is  size  normalized  by  the 
perceived  area  of  the  object  M w  while  Dudani  ignores  this  area  moment  value. 

2.7.  Summary  of  Kesults 

The  following  summarizes  the  best  results  which  have  been  obtained  on  clean  and  noisj 
test  data  for  the  two  most  promising  techniques,  aspect  ratio  normalized  silhouette  moments 
and  Fourier  descriptors: 


Classification  Success  I 

No.  of  Feature 

Percentage  Correctly  Classified 

Vector  Elements 

Standard  Moments 

Fourier  Descriptors 

6 

910(85.7) 

77.7  (75.0) 

11 

913  (89.7) 

90.7(824) 

17 

913(89.7) 

904(850) 

24 

92.7  (91.0) 

91.7(850) 

The  figures  in  parenthesis  are  for  a  noisy  set  of  unknowns.  For  moment  invariants  of  the 
silhouette  (7  feature  vector  elements)  the  highest  recognition  rate  was  68.0%  for  clean  data 
and  69.3%  for  noisy  data.  Adding  boundary  moment  invariants  gave  worse  results.  The  above 
results  indicate  that  there  is  very  little  difference  between  the  performance  of  Fourier 
descriptors  and  standard  moments  for  this  task;  both  do  very  well.  Moment  invariants  did 
considerably  worse  than  the  other  techniques.  The  method  used  for  normalization 
significantly  affects  the  results.  In  general,  the  addition  of  boundary  moments  did  not 
improve  the  classification  results  for  a  given  number  of  feature  vectors  and  boundary 
moments  by  themselves  were  not  very  good. 


3.  Analysis  and  Modelling  of  the  BQM-34  Drone  Imagery 

The  FUR  images  of  the  BQM-34  drone  plane  provide  a  database  of  high  noise  representa¬ 
tions,  exemplifying  the  type  of  image  corruption  introduced  by  atmospheric  inhomogeneities: 
The  analysis  and  understanding  of  this  type  of  data  is  necessary  to  obtain  robust  image 
identification  procedures.  In  particular  we  would  like  to  examine  the  effects  of  such  noise  on 
image  classification  by  the  method  of  moments: 

One  method  for  reducing  additive  noise  is  the  averaging  of  multiple  distinct  images: 
This  report  examined  the  correspondence  of  varying  size  multi-image  group  averages  to  an 
ideal  model.  By  making  the  comparison  in  the  moment  domain  for  both  the  averaging  of 
moment  sets,  and  of  greylevel  images,  we  compared  these  two  noise  removal  approaches  from 
the  standpoint  of  producing  feature  vectors  suitable  for  image  identification. 

For  realistically  modelled  image  aquisitian,  the  ease  of  location  and  orientation  normali¬ 
zation  of  moments  makes  the  method  potentially  very  attractive  for  the  reduction  of  noise 
effects  by  averaging.  In  particular  we  examined  the  situation  where  there  was  uncertainty 
about  the  object’s  location  within  an  image  frame.  This  scenario  would  be  typical  of  most 
situations  where  one  or  both  of  the  observer  and  the  observed  object  are  moving. 

3.1.  Experimental  Methods 

3.1.1.  The  Geometric  Model 

One  of  the  first  concerns  was  to  produce  an  idealized  version  of  the  BQM-34  drone  plane 
to  create  both  a  reference  for  comparisons  and  a  base  for  noise  simulations.  A  polygonal 
representation  of  the  drone  was  produced  based  on  published  measurements.  This  representa¬ 
tion  was  then  rotated  until  a  visual  best  match  to  real  drone  data  was  found.  This  orientation 
was  then  used  for  all  experiments.  Care  was  also  taken  to  match  the  resolution  of  the  real 
data  as  closely  as  poadble. 


Observation  of  the  FUR  drone  images  in  comparison  to  the  published  specifications  indi¬ 
cated  some  discrepancies.  Most  notably,  the  pronounced  tail  cone  section  was  not  visible  in  the 
real  data.  This  might  be  an  artifact  of  the  range  imaging  process,  but  in  any  case  it  is  a  source 
of  variation  between  the  model  and  real  data  moments.  It  is  important  to  realize  that  a  per¬ 
fect  match  is  possible  between  the  noisy  model  and  our  ideal,  since  the  noisy  images  are  based 
on  the  ideal.  No  such  perfect  match  is  possible  due  to  averaging  for  the  real  data,  since  the 
ideal  for  the  real  data  is  not  identical  to  the  model  ideal  Figure  3.1  shows  some  representa¬ 
tive  real  and  model  images: 

3.1.2.  Noise  and  Preprocessing 

The  drone  FUR  data  contained  substantial  real  atmospheric  and  measurement  noise. 
These  drone  images  were  preprocessed  prior  to  taking  the  moments  of  an  individual  image  by 
a  3  by  3  mean  filtering.  This  filtering  removed  stray  background  pixels  that  would  otherwise 
be  misclassed  as  object  when  segmented  from  the  background.  For  the  multi-image  averages 
the  mean  filtering  was  found  to  be  unnecessary. 

The  artificial  drone  images  received  a  slightly  more  complex  treatment.  To  produce  the 
noisy  images,  an  ideal  silhouette  of  the  model  drone  was  created  with  an  intensity  value  of 
128.  Gaussian  noise  with  a  standard  deviation  of  30  was  then  added  to  this  model  to  produce 
the  noisy  images. 

These  artificial  noisy  images  were  then  mean  filtered,  thresholded,  and  processed  to 
remove  noise  pixels  that  were  not  8  connected  to  the  main  body  of  the  object.  The  latter  pro¬ 
cessing  step  removed  spurious  noise  spots  in  the  image,  as  did  the  mean  filtering  used  on  the 
real  drone  data.  However,  a  higher  degree  of  object  distortion  was  maintained  by  the  non¬ 
mean  filtering  technique,  which  allowed  the  noisy  model  data  to  more  accurately  simulate  the 
real  drone  data. 

The  preprocessing  for  noise  reduction  was  intentionally  kept  simple,  to  avoid  obscuring 
the  effects  of  the  grey  level  averaging.  The  fundamental  interest  of  this  work  concerned  the 
quantification  of  the  effects  of  turbulence  and  measurement  noise,  and  the  reduction  of  th»w» 
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effects  afforded  by  image  averaging.  In  particular,  the- extra  processing  of  the  artificial  images 
was  performed  solely  to  produce  a  reasonable  simulation  of  the  real  data. 

3.13.  Grey  level  Versus  Moment  Domain  Averaging 

The  basic  concern  of  this  experimentation  is  to  determine  the  relative  merits  of  averag¬ 
ing  images  in  the  moment  domain  versus  averaging  in  the  image  Hftm»in.  The  final  intent  is  to 
produce  silhouette  moment-based  feature  vectors  with  reduced  noise  effects.  A  secondary 
question,  for  either  of  these  two  techniques,  is  what  effect  does  the  number  of  images  averaged 
have  on  the  convergence  of  the  averaged  result  to  the  ideal. 

The  technique  used  to  address  both  these  concerns  involved  the  partitioning  of  data  sets 
of  40  images  into  groups  containing  1,  5,  10,  15,  20,  and  40  distinct  and  different  images 
(specifically  40,  8,  4, 2, 2,  and  1  groups,  respectively).  The  members  of  these  groups  were  then 
averaged  in  both  the  greylevel  and  the  image  domain,  and  the  silhouette  moment  set  associ¬ 
ated  with  each  of  these  two  averagings  was  then  compared  to  the  ideal  silhouette  moment  set. 
The  figure  of  merit  for  the  comparison  was  the  Euclidean  distance  between  the  moment  sets. 
All  the  Euclidean  distances  for  a  given  group  size  and  averaging  technique  were  then  aver¬ 
aged  together  to  come  up  with  a  representative  distance  figure  for  groups  of  that  particular 
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Two  types  of  greylevel  averaging  are  possible.  The  first  is  to  actually  add  up  a  series  of 
greylevel  values  for  each  pixel  point  and  then  determine  the  actual  pixel  average.  This  aver¬ 
aged  image  is  then  thresholded  to  produce  a  silhouette  image.  The  second  possibility  is  to 
threshold  the  images  prior  to  averaging,  and  then  take  the  median  value  of  the  series  of 
binary  values.  This  latter  method  has  the  potential  advantage  of  requiring  the  manipulation 
of  less  data,  which,  in  certain  situations  might  t*  fWer  and  more  efficient.  Both  techniques 
were  examined  for  this  work. 

The  two  data  sets  examined  were  the  real  FLIR  drone  imagery,  and  a  synthetic  data  base 
generated  by  adding  gauasian  noise  to  silhouettes  of  the  drone  model.  The  initial  averaging 
tests  amumed  perfect  image  to  image  registration.  Specifically,  the  drone  images  were  averaged 


directly,  without  attempting  to  spatially  center  the  images:  The  model  data  base  similarly 
started  with  the  clean  silhouette  in  the  same  position  in  each  frame,  and  then  the  noise  was 
superimposed  onto  it.  Both  these  correspond  to  the  assumption  of  a  fixed  camera  view  of  a  sta¬ 
tionary  object;  even  though  the  image  is  corrupted  by  noise,  its  current  position  is  recognized 
as  being  correct  on  the  average. 

The  alternate  strategy  assumes  that  the  object’s  position  within  the  image  cannot  be 
specified  with  absolute  certainty.  This  would  be  the  case  in  tracking  a  moving  object.  In  this 
situation,  to  accomplish  greylevel  averaging  it  is  necessary  to  reregister  the  object  within  the 
image,  so  that  all  objects  are  spatially  aligned.  The  normalization  process  for  moments  elim¬ 
inates  translational  and  rotational  discrepancies  between  images;  and  thus  the  moment  averag¬ 
ing  results  perform  this  reregistration  in  the  moment  domain  for  all  results. 

For  the  greylevel  averaging,  the  reregistration  was  assumed  to  require  only  translational 
correction  and  not  rotational  alteration.  This  would  be  realistic  in  situations  where  the 
multi-image  sequence  could  be  obtained  at  a  rate  substantially  greater  than  the  rate  at  which 
the  observed  object  changes  course.  The  technique  was  to  select  the  first  image  in  the 
sequence,  and  then  correlate  its  silhouette  with  the  silhouette  of  all  the  other  images  in  the 
data  base,  correcting  the  object  position  in  these  latter  images  to  agree  as  closely  as  possible 
with  the  first  image.  The  greylevel  averaging  was  then  performed. 

For  the  model  data,  the  problem  of  misregistration  by  less  than  one  pixel  was  directly 
introduced.  Prior  to  the  addition  of  noise,  four  ideal  images  were  generated  that  varied  in 
registration  from  the  original  model  by,  respectively,  zero  pixels  (the  original},  one  half  pixel 
to  the  right,  one  half  pixel  downward,  and  one  half  pixel  to  the  right  and  downward.  These 
subpixel  shifts  were  accomplished  by  performing  full  pixel  shifts  in  a  double  sized  image,  and 
then  shrinking  the  image  by  polling  the  contents  of  a  two  by  two  window.  The  result  was 
said  to  be  object  if  more  than  two  pixels  in  the  window  were  object.  Ten  noisy  versions  of 
each  of  these  ideal  images  were  then  created,  to  give  a  40  image  data  set  These  images  were 
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than  reregistered  by  comparison  to  an  arbitrarily  selected  reference  image  from  the  data  set 

12.  Averaging  Results 

The  results  of  the  first  experiment  could  be  labelled  perfectly  registered  data,  since  the 
camera  and  object  were  identically  aligned  for  each  image.  Thus,  if  the  image  disturbances 
tend  to  vary  uniformly  about  the  true  value,  we  would  expect  averaging  in  greylevel  domain 
to  be  effective  far  noise  reduction.  The  location  normalization  far  standard  moments  reacts  to 
the  slight  image  to  image  shape  variation  due  to  noise,  and  consequently  the  ideal  registration 
is  lost  in  the  moment  domain.  This  effect  puts  moment  averaging  at  a  disadvantage  for  this 
dataset. 

The  results  for  moment  and  greylevel  averaging  without  and  with  aspect  ratio  normali¬ 
zation  are  shown  in  figures  12  and  11  respectively.  The  greylevel  averaging  was  performed 
using  the  actual  greylevel  for  the  real  drone  data,  and  using  silhouettes  for  the  model  data. 
The  process  of  aspect  ratio  normalization  can  be  viewed  as  a  distortion  of  the  object’s  dimen¬ 
sions  to  produce  equal  moments  of  inertia  about  the  2  coordinate  axes.  The  original  aspect 
ratio  is  retained  as  a  feature  vector  element 

The  reregistered  results  are  shown  in  figures  14  through  17.  The  figures  14  and  3-5 
give  the  results  for  the  averaging  of  greylevel  images,  and  the  remaining  two  figures  show  the 
results  for  the  averaging  of  silhouette  images.  Again  both  aspect  ratio  and  non-aspect  ratio 
normalized  results  are  presented. 

13.  Summary  of  Image  Averaging 

For  data  which  is  perfectly  registered,  our  results  indicate  that  at  best  moment  domain 
averaging  is  comparable  to  greylevel  averaging.  This  is  to  be  expected,  since  the  necessary 
discretization  of  an  object’s  relocation  in  image  space  is  not  a  disadvantage.  However,  since  an 
object  can  be  continuously  relocated  in  the  moment  domain,  it  would  be  expected  that 
imagery  with  fractional  pixel  displacements  might  be  more  successfully  averaged  in  moment 
space.  A  very  significant  consideration  is  that  object  relocation  in  any  realistic  situation  is 
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Figure  3-2. 

Perfectly  registered  data  results  for  moment  and  greylevel  averaging  of  standard 
moments. 
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Figure  3.3. 

Perfectly  registered  data  results  for  moment  and  grey  level  averaging  of  aspect  ratio  nor 
malized  moments. 
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Figure  3-4. 

RMulta  for  moment  and  greylevel  averaging  of  the  atandard  momenta  of  the  reregistered 
data.  The  greylevel  averaging  was  performed  using  actual  greylevel  images. 
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Figure  3-5. 

Results  for  moment  end  grey  level  avenging  of  the  aspect  ratio  normalized  moments  of 
the  reregistered  data.  The  grey  level  avenging  was  performed  using  actual  greylevel 
images. 
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Figure  3i. 

Results  for  moment  tad  grsjrkvel  averaging  of  the  standard  moments  of  the  reregistered 
data.  The  greylerel  averaging  was  performed  uaiag  binary  silhouette  images. 
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Figure  3.7. 

Results  for  moment  and  grey  level  averaging  of  the  aspect  ratio  normalized  moments  of 
the  reregistered  data.  The  greylevel  averaging  was  performed  using  binary  silhouette 
images. 
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much  lea  computationally  costly  in  the  moment  domain  than  in  the  image  domain. 

The  results  for  the  reregistered  data  show  that  moment  averaging  is,  in  a  number  of 
cases,  much  more  successful  than  greylevel  averaging.  In  particular,  for  averaging  actual 
grey  level  image*,  without  aspect  ratio  normalisation,  moment  averaging  produces  superior 
results.  The  introduction  of  aspect  ratio  normalization  in  all  cases  produces  better  results  for 
greylevel  averaging  of  the  real  drone  data. 

The  effects  of  aspect  ratio  normalization  on  these  results  is  noteworthy.  For  the  real 
drone  data,  any  improvement  resulting  from  moment  averaging  seems  to  be  obviated  by  the 
process  of  aspect  ratio  normalization.  This  does  not  hold  true  for  the  model  data.  In  general, 
the  overall  improvement  in  data  quality  from  averaging  in  either  moment  or  image  domain  is 
not  as  notable  with  aspect  ratio  normalization  as  without. 

Since  earlier  results  have  indicated  that  superior  object  identification  results  are  obtained 
from  aspect  ratio  normalized  moment  sets  (see  also  the  next  section  of  this  report),  the  conclu¬ 
sion  is  that  aspect  ratio  normalization  reduces  the  sensitivity  of  the  moments  to  noise.  The 
mechanism  that  achieves  this  is  quite  basic;  the  further  a  noise  pixel  is  located  from  the  cen¬ 
troid  of  an  object,  the  greater  its  relative  effect  on  that  object’s  moments.  Aspect  ratio  normal¬ 
ization  contracts  protruding  portions;  and  expands  compressed  regions;  of  an  object  that  make 
the  aspect  ratio  non-circular.  Thus,  for  the  drone  image,  noise  on  highly  corruptible  image 
areas,  such  as  the  wing  tips,  may  have  a  much  smaller  relative  effect  on  the  moments  after 
aspect  ratio  normalization. 

A  simple  experiment  was  performed  to  verify  this  hypothesis.  A  comparison  by 
Euclidean  distance  was  made  between  the  ideal  model’s  moments,  and  the  moments  of  the 
model  with  one  pixel  removed  on  a  wing  tip,  and  with  one  pixel  removed  from  an  extreme 
point  of  the  body.  The  results  showed  that  the  Euclidean  distance  to  the  model  missing  the 
wing  pixel  was  four  times  larger  than  the  distance  to  the  model  missing  the  body  pixel,  for 
standard  moments.  But  these  results  were  reversed  for  aspect  ratio  normalized  moment  sets; 
the  ratio  was  now  1  to  3,  instead  of  4  to  1.  Hence,  after  aspect  ratio  normalization,  the  wing 


tip  pixel  error  produced  a  much  smaller  relative  change  in  the  moment  values. 

The  effect  of  group  size  on  averaging  improvement  seems  fairly  uniform  for  both 
grey  level  and  moment  averaging.  In  most  cases,  an  averaging  of  5  frames  seems  to  produce 
most  of  the  improvement.  In  all  cases  very  little,  if  any  improvement  is  realized  by  averaging 
more  than  15  images. 

A  tertiary  conclusion  is  that  averaging  of  silhouette  images  is  more  effective  for  noise 
reduction  than  averaging  the  unthresholded  grey  level  images.  This  is  probably  an  artifact  of 
the  preprocessing  that  is  performed  on  the  silhouette  images.  This  effect  is  particularly  not¬ 
able  for  the  real  drone  data. 

Overall,  then,  the  results  for  moment  averaging  are  better  than  those  for  greylevel 
averaging  when  there  is  uncertainty  about  the  object’s  position  within  the  image.  Under  some 
conditions;  determined  by  the  conformation  of  the  object,  aspect  ratio  normalization  may 
decrease,  or  eliminate  the  noise  reducing  effects  of  multiple  image  averaging.  In  cases  where 
image  averaging  does  improve  the  data,  an  average  of  5  to  15  images  should  be  sufficient 
Additionally,  averaging  of  silhouette  images  for  greylevel  averaging  produces  the  best  results: 


4.  Classification  Using  Moment  Subsets 


The  primary  purpose  of  a  feature  vector  representation  of  an  image  is  to  achieve 
identification.  The  greatly  reduced  dimensionality  of  the  feature  vector,  as  compared  to  the 
original  image,  makes  possible  techniques  such  as  library  matching  for  object  classification. 
Clearly,  in  the  spirit  of  this  approach,  it  is  desirable  to  use  the  fewest  descriptive  numbers  pos¬ 
sible  to  accurately  characterize  an  image. 

This  section  considers  the  possibility  of  image  classification  using  various  complete 
moment  set  (CMS)  subsets.  This  examination  is  intended  to  give  increased  insight  into  the 
value  of  moments  with  certain  common  characteristics  for  uniquely  identifying  samples  from 
a  six  airplane  data  set. 

4.1.  Experimental  Methods 

The  classification  experiments  carried  out  here  examined  moments  that  were  normalized 
for  size,  translation,  and  orientation.  A  distinction  was  also  made  for  normalized  moments 
with,  and  without,  aspect  ratio  normalization.  The  experimental  technique  for  classification 
used  a  nearest  neighbor  Euclidean  distance  metric,  where  all  redundant  or  trivial  information 
was  removed  from  the  feature  vectors.  In  the  case  of  aspect  ratio  normalized  moment  subset* 
the  aspect  ratio  was  included  in  all  subsets  for  classification  purposes.  All  images  contained 
only  silhouette  data. 

Moments  up  to  order  6  were  considered  in  these  trials.  A  set  of  252  unknown  views  of 
each  of  6  airplanes  were  classified  using  a  known,  or  library,  data  set  of  500  views  of  each  of 
the  same  6  airplanes.  The  classification  was  deemed  correct  if  the  unknown  view  was  labelled 
as  being  the  appropriate  airplane. 

The  design  of  the  classification  task  was  similar  to  that  described  in  section  2,  except  that 
a  more  regimented  procedure  was  defined  for  determining  the  viewing  angles.  The  technique 
involved  approximating  an  even  partitioning  of  the  surface  of  a  sphere  by  using  views  on  the 
facet  of  a  polyhedron.  These  views  were  used  as  the  known  library  view*  and  then  a  set  of 
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worst  case  unknown  views  were  generated  using  viewing  positions  located  at  the  polyhedron’s 
vertices.  The  views  are  termed  worst  case,  since  they  represent  the  interstitial  point  furthest 
from  the  5  or  6  near  neighbor  library  views. 

Further  normalization  of  the  moment  sets  was  achieved  using  the  technique  of  variance 
balancing.  This  involved  determining  the  standard  deviation  of  a  given  moment  value  over 
the  entire  range  of  library  views.  All  moment  values  in  both  the  library  views  and  the  unk¬ 
nown  views  were  then  normalized  by  their  respective  standard  deviation.  This  step  was  per¬ 
formed  after  all  other  moment  set  normalizations,  and  served  to  deemphasize  highly  variable 
moment  values  in  the  Euclidean  distance  measurement 

4.2.  Clean  Subset  Results 

The  main  analysis  was  performed  on  noiseless,  or  dean  data.  The  most  obvious  moment 
subsets  to  consider  are  the  CMS  subsets  of  our  order  6  CMS.  Figure  4.1  shows  these  results  for 
CMS  of  order  3»  4,  5,  and  6,  with,  and  without,  aspect  ratio  normalization.  One  observation  is 
that  the  change  from  an  order  4  to  order  5  CMS  gives  an  improvement  in  performance  that  is 
disproportionate  to  the  increase  in  feature  vector  size.  Conversely,  there  is  little  or  no 
improvement  in  classification  success  for  an  order  6  CMS,  as  compared  to  an  order  5  CMS.  In 
all  cases,  aspect  ratio  normalization  gives  superior  results  to  those  for  moment  sets  without  this 
information.  This  result  will  be  reenforced  by  the  other  results  presented. 

The  next  class  of  subsets  tested  were  those  composed  solely  of  moments  of  a  selected 
order.  Orders  3,  4,  5,  and  6  were  considered  individually;  the  results  are  presented  in  figure 
4J L  Aspect  ratio  normalized  moments  again  show  superior  results  to  moment  sets  without  this 
treatment.  Most  importantly,  however,  it  should  be  observed  that  the  odd  order  moments 
give  better  results  than  the  even  order  moments  for  this  small  sample.  The  order  5  moment 
subset  gave  results  equivalent  to  the  order  3  CMS  classification  results,  where  both  are  of  simi¬ 
lar  size. 

The  results  in  figure  4.2  help  explain  the  CMS  results.  The  conclusion  would  seem  to  be 
that,  for  at  least  this  silhouette  data  set,  the  order  5  moments  are  very  important  to  the 
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Figure  4.1. 

Classification  results  for  complete  moment  sets  of  order  3,  4,  5,  and  6.  Both  standard 
moment  and  aspect  ratio  normalized  moment  results  are  shown. 
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Figure  43. 

Classification  results  for  moments  with  even,  and  partially  even  indices.  Both  standard 
moment  and  aspect  ratio  normalized  moment  results  are  shown. 
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classification  success  rate.  Hence,  a  large  improvement  in  classification  success  is  observed 
when  an  order  5  CMS  is  compared  to  an  order  4  CMS.  A  possible  generalization,  which 
would  require  more  experimentation  to  validate,  is  that  odd  order  moments  are  more  impor¬ 
tant  to  classifying  silhouette  data  than  even  order  moments.  In  general,  then,  it  is  possible 
that  adding  the  next  odd  order  of  moments  to  a  given  feature  vector  could  be  the  most 
efficient  way  to  increase  classification  success. 

Figure  4.3  shows  the  results  for  moments  with  even  and  partially  even  order  indices. 
Due  to  the  nature  of  the  moment  calculations;  the  moment  values  with  both  indices  even 
numbers  tend  to  have  the  largest  values  for  a  given  order.  Thus  it  is  interesting  to  see  if  this 
relative  size  difference  has  any  bearing  on  the  classification  success  rate. 

Figure  4.3  indicates  that  strictly  even  indexed  moments  have  no  notable  success  for 
classification.  Adding  in  moments  with  only  partially  even  indices  dramatically  improves  the 
results,  which  now  approach  the  success  level  of  a  similarly  sized  CMS,  though  still  not  quite 
as  good.  These  results  suggest  that  moments  with  even  indices  do  not  have  any  special  proper¬ 
ties  that  single  them  out  as  desirable  for  classification  purposes. 

The  results  for  moments  with  strictly  odd  indices  are  very  similar  to  those  for  strictly 
even  indices:  Table  4.1  shows  these  and  some  other  results.  The  expression  axis  projection 
refers  to  all  moments  that  have  one  specific  index  equal  to  zero.  This  is  tantamount  to  deter¬ 
mining  the  moments  of  a  projection  of  the  image  onto  one  of  the  coordinate  axes.  After  rota¬ 
tion  normalization,  the  long  axis  of  the  object  silhouette  is  oriented  along  the  x  axis.  Table  4.1 
indicates  that  the  moments  of  this  long  axis  projection  are  much  better  than  the  y  axis  projec¬ 
tion  for  classification  purposes.  Aspect  ratio  normalization  eliminates  this  discrepancy  between 
the  projections,  and  adds  a  new  piece  of  information  in  the  form  of  the  aspect  ratio,  and  conse¬ 
quently  reduces  the  gap  in  success  between  the  two  classification  efforts.  Classification  using 
both  axis  projection  moments  shows  improvement  that  at  best  is  of  the  order  that  would  be 
expected  from  doubling  the  feature  vector  size. 


Moment  Subset  Classification  Results* 


Subset  Number  of  Elements  Results 


odd  moment  indices  5 


x  axis  projection  5  (6)  47.4  (73-2) 


on  5(6)  36.4(70.1) 


ions  10  (10)  653  (81.9) 


BC2IS3S3 


•aspect  ratio  normalized  results  in  parenthesis 

In  general,  the  subsets  summarized  in  table  4.1  do  not  produce  exceptionally  good 

classification  results,  the  results  being  clearly  inferior  to  the  CMS  results,  and  equivalent  or 
slightly  better  than  the  strictly  even  moment  indices  tests.  Again,  the  results  reassert  that 
aspect  ratio  normalization  is,  in  all  cases,  worthwhile. 

The  experiments  above  reenforce  each  other.  For  example,  the  poor  results  for  both  all 
odd  and  all  even  moment  indices  make  the  poor  results  for  even  order  moments  not  at  all 
surprising,  since  all  moments  in  an  even  order  will  have  both  indices  odd  or  both  even.  Simi¬ 
larly,  an  odd  moment  order  will  have  all  mixed  indices.  Thus  the  tests  of  strictly  even,  and 
even  and  partially  even  indexed  moments  in  figure  4.3  simply  means  we  are  comparing  a 
classification  of  even  order  moments  to  one  of  even  and  odd  order  moments.  The  only  reason 
to  compare  classification  success  for  moments  with  both  indices  even,  and  both  odd,  is  to 
attempt  to  isolate  why  even  order  moments  perform  so  inadequately. 

The  final  tests  involve  actually  applying  the  results  of  the  above  experiments.  Table  42 
shows  some  comparisons  of  different  moment  subset  classifications.  The  entries  are  ordered  by 
feature  vector  length,  and  all  are  aspect  ratio  normalized.  The  intent  is  to  attempt 
classifications  using  just  odd  order  moments,  with  various  pieces  of  additional  information  also 

included.  The  results  for  several  CMS  sizes  are  shown  for  comparative  purposes. 

Table  42 


Ratio  Normalized  Moment  Subset  Classification  Results 


Subset 

Number  of  Elements 

Results 

CMS  of  order  5 

17 

93-5 

Aspect  ratio,  orders  2,  3,  5 

12 

93.3 

11 

90-5 

CMS  of  order  4 

11 

90-5 

Orders  3  and  5 

10 

90.1 

CMS  of  order  3 

6 

88.4 
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Table  42  points  out  a  previously  unvoiced  assumption:  the  order  2  moments,  though 
even,  are  very  important  for  classification  success.  The  reasoning  is  that  the  low  order 
moments  contain  very  fundamental  information  about  an  object,  such  as  area,  location  of  the 
centriod,  and  approximating  ellipse.  Higher  order  moments  would  then  contain  more  detailed 
information,  what  might  heuristically  considered  to  be  high  frequency  variation.  As  an 
extreme  example,  the  moments  of  a  circle  and  an  ellipse,  after  full  normalization  (including 
aspect  ratio),  might  differ  only  by  their  aspect  ratios;  which  are  a  function  of  their  order  2 
moments.  In  table  42,  adding  the  order  2  moments  to  a  feature  vector  already  containing  the 
aspect  ratio  and  the  order  3  and  5  moments  dramatically  increases  the  classification  success 
rate,  at  the  cost  of  only  1  element  more  in  length. 

42.1.  Noisy  Subset  Results 

An  examination  of  the  same  subsets  as  described  above  was  performed  for  noisy  image 
data.  The  noise  consisted  of  a  boundary  perturbation  of  the  silhouette  image  by  randomly 
removing  some  of  the  object’s  edge  pixels.  The  image  resolution  was  also  reduced  by  25  per¬ 
cent.  Figure  44  shows  some  sample  clean  and  noisy  silhouettes.  This  type  of  noise  is  not  as 
harsh  as  some  types  examined,  but  is  a  reasonable  approximation  to  the  type  of  noise  a  range 
finding  imaging  device  might  produce. 

In  general,  the  previous  results  are  directly  supported.  The  noisy  trials  were  only  per¬ 
formed  for  aspect  ratio  normalized  feature  vectors,  since  all  experimentation  to  date  has  indi¬ 
cated  this  type  of  moment  normalization  improves  classification  success,  and  hence  is  of  the 
most  interest  to  us  here.  The  classification  results  for  the  noisy  data  seem  to  fall  universally 
about  2  to  5  percent  short  of  the  clean  results,  and  consequently  support  the  clean  result 
trends. 


43.  Summary 

As  the  classification  success  becomes  very  high  for  large  moment  based  feature  vectors,  it 
becomes  increasingly  harder  to  improve  the  success  rate  without  adding  comparatively  large 
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numbers  of  elements  to  the  feature  vectors.  The  intent  of  this  research  was  to  determine  if 
certain  characteristics  could  be  identified  that  were  common  to  moments  that  had  either  a 
positive  or  negative  correlation  with  classification  success.  The  logical  supposition  is  that,  at  a 
high  level  of  classification  success,  some  momenta  may  be  adding  ambiguity  to  the  classification 
attempts;  rather  than  clarity.  Consequently  these  moment  values  should  be  eliminated  from 
the  sample. 

On  the  most  superficial  level,  the  results  here  suggest  that  a  CMS  is  probably  the  best 
choice  for  the  most  successful  and  economical  classification  attempts:  It  also  is  apparent  that 
aspect  ratio  normalization  improves  the  results  for  any  given  silhouette  moment  set.  Most  of 
the  remaining  moment  subsets  examined  produce  similar  results  that  are  inferior  to  those  for 
the  CMS 

A  more  subtle  result  is  that,  for  the  small  sample  size  examined  here,  odd  moment  orders 
are  superior  to  even  moment  orders  for  classification  purposes.  Specifically,  for  the  aspect  ratio 
normalized  moments  we  find  that  the  moments  of  order  5  give  better  results  than  a  CMS  of 
order  3,  where  both  contain  the  same  number  of  elements.  It  might  be  worthwhile  to  try  and 
extend  this  result  at  some  point  by  examining  higher  moment  orders,  but  the  initial  conclu¬ 
sion  must  be  that  a  CMS  based  classification  effort  should  contain  an  odd  order  as  the  max¬ 
imum  order  in  the  set  for  best  results. 

Similarly,  if  information  must  be  eliminated  from  a  CMS  to  reduce  the  feature  vector 
size,  it  is  probably  best  to  eliminate  the  even  moment  orders,  corresponding  to  those  moments 
with  all  even  or  all  odd  indices.  Trying  this  experiment  shows  that  a  feature  vector  contain¬ 
ing  aspect  ratio  normalized  moments  of  orders  2,  3,  and  5,  and  the  aspect  ratio;  exhibits  a 
reduction  in  classification  success  of  only  .6  percent  from  an  order  6  CMS,  and  yet  contains 
only  one-half  as  many  elements.  Hence  a  29  percent  size  reduction  of  the  order  5  CMS 
feature  vector,  and  a  50  percent  reduction  of  the  order  6  CMS,  is  achieved  with  a  dispropor- 
tionatly  small  decrease  in  classification  success. 
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The  suggestion  would  seem  to  be  that,  in  general,  not  all  moment  values  are  of  equal 
import  for  object  recognition.  In  situations  where  the  views  are  more  typical  or  consistent 
than  in  the  6  airplane  experiment  presented  here,  it  may  well  be  possible  to  identify  very 
specifically  the  moment  values  necessary  for  object  identification  from  silhouette  imagery. 


5.  Image  Reconstruction  from  Moments 

The  main  application  of  moments  in  image  processing  has  been  for  object  identification. 
For  example,  the  reduced  dimensionality  of  the  moment  based  feature  space  mekea  possible 
the  use  of  library  matching  techniques.  An  interesting  question  is  how  well  can  the  original 
image  be  recreated  from  a  set  of  its  moments.  The  theory  suggests  that  a  perfect  reconstruc¬ 
tion  of  a  continuous  image  requires  an  infinite  set  of  moments.  However,  a  suboptimal  recon¬ 
struction  may  still  retain  the  significant  traits  of  the  original. 

A  further  consideration  is  that,  when  reconstructing  silhouette  images,  there  are  only 
two  intensity  values.  Hence,  it  is  possible  that  such  a  priori  knowledge  would  allow  a  recon¬ 
struction  far  more  accurate  than  might  initially  be  anticipated.  Since  the  data  analysis  in  this 
report  is  based  on  silhouette  imagery,  this  type  of  reconstruction  is  of  particular  interest 

Teague  [4]  considered  possible  techniques  for  image  reconstruction  using  an  inverse 
moment  transform.  He  identified  two  methods,  one  using  standard  moments,  and  one  using 
Legendre  polynomial-based  moments.  The  first  approach  produces  a  number  of  sets  of  coupled 
equations.  These  equations  can  be  solved  to  give  the  coefficients  of  a  polynomial  as  a  function 
of  all  moments  of  order  n  and  lower,  where  n  is  the  degree  of  the  polynomial  This  polyno¬ 
mial  defines  a  continuous  image  function  that  has  the  mme  moments  as  the  original  up  to  the 
order  utilized  in  the  reconstruction. 

Key  problems  for  this  approach  are  the  solution  of  coupled  sets  of  equations,  and  the 
necessity  of  recomputing  the  polynomial  coefficients  for  a  larger  order  moment  solution. 
Teague's  [4]  second  option  suffers  from  neither  of  these  problems;  and  is  examined  here,  along 


with  an  iterative  technique  that  dramatically  improves  silhouette  reconstruction!  results. 

5.1.  Image  Reconstruction,  from  Legendre  Moments 

5.1.1.  Legendre  Moments 

The  Legendre  moments  of  an  image  are  generated  similarly  to  conventional  moments. 
The  difference  is  that  the  basis  functions  for  Legendre  moments  are  Legendre  polynomials, 
rather  than  the  monomials  of  z  and  y  found  in  the  standard  moments.  Specifically  [4fc 

ff  fOc,y)PM  (x)Pm(y)  dx  dy  (5.1) 

where  denotes  the  Legendre  moment  of  order  m+n,  and  Pm(x)  refers  to  the  Legendre 
polynomial  in  z  of  order  m.  The  Legendre  moments  can  also  be  generated  as  linear  combina¬ 
tions  of  the  conventional  moments  [4],  Furthermore,  a  complete  moment  set  of  the  Legendre 
moments  contains  the  same  total  amount  of  information  as  a  conventional  moment  set  of  the 
same  order. 

However,  Legendre  and  conventional  moments  are  not  entirely  equivalent.  In  particu¬ 
lar,  Legendre  polynomials  are  orthogonal  in  the  interval  [-1,1],  which  means  that  the  moments 
of  an  object  can  be  determined  using  orthogonal  basis  functions,  if  the  object  is  scaled  to  fit 
dimensionally  into  these  limits.  The  result  of  using  orthogonal  Legendre  moments  in  an  image 
reconstruction  attempt  is  that  the  algebraic  equations  to  determine  the  inverse  transform  poly¬ 
nomial  coefficients  are  no  longer  coupled.  Additionally,  these  polynomial  coefficients  no  longer 
change  when  the  moment  order  considered  charges,  allowing  easy  precomputation  of  the 
necessary  values. 

The  reconstructions  resulting  from  Legendre  moments  and  the  conventional  moments 
are  identical,  since  a  complete  moment  set  of  either  to  order  n  contains  exactly  the  same  infor¬ 
mation.  The  Legendre  moments  simply  present  the  information  in  a  particularly  tractable 


and  efficient  format. 


5.1.2.  The  Reconstruction  Technique 

The  polynomial  defining  the  image  reconstruction  for  a  complete,  but  finite  Legendre 
moment  set  can  be  expressed  as  [4j 

if 

gCx,y)*  £  £  Ln-»»  PS-»(x)  P*(y)  (5.2) 

N  *Oa«0 

The  Legendre  polynomials  in  the  above  are  normalised  for  the  [-1,1]  interval  [4J.  Equation 
(5.2)  yields  a  continuous  function,  g  Cx  ,y  X  with  the  same  moments  to  order  N  as  the  original 
discretely  sampled  image  function.  If  gCx  ,y)  is  discretely  sampled,  and  additionally  thres- 
bolded  into  a  silhouette  image,  the  moments  will  no  longer  match  those  of  the  original. 

The  problem  of  perfectly  reconstructing  a  binary  valued,  discretely  sampled  image 
directly  from  this  method  is  impossible,  since  the  original  image  violates  necessary  continuity 
assumptions.  Consequently,  even  increasing  the  order  of  the  moment  set  used  in  the  recon¬ 
struction  will  not  guarantee  a  good  result.  In  an  effort  to  compensate  for  this  problem,  an 
iterative  scheme  using  error  feedback,  was  devised  to  help  reconstruct  silhouette  images. 

The  fundamental  approach  in  this  iterative  scheme  was  based  on  the  fact  that  the 
moment  transform  is  a  linear  operation.  This  as  an  example,  that  the  moments  of  the 

difference  between  two  images  are  the  mme  as  the  difference  of  the  two  image’s  moments. 
Using  this  information,  an  error  image  can  be  reconstructed  from  the  moment  set  error,  and 
then  subtracted  from  the  current  reconstruction  to  enhance  its  accuracy. 

The  actual  algorithm,  then,  produces  an  iterative  image  reconstruction  by  negative  feed¬ 
back  of  the  error.  An  outline  of  this  procedure  is 

(l)  Perform  the  basic  image  reconstruction  from  the  Legendre  moments  to  produce  invagefO) 


(3)  Produce  a  thresholded  image,  binaryimage(irl),  by  calculating  the  threshold  point  that 
yields  the  same  image  size  as  in  the  original  image  (specifically  equal  Loo) 

(A)  Calculate  the  Legendre  moments  of  binaryimage(i-l),  calling  these  moments  LM(i) 

(5)  Determine  the  difference  between  the  moments  of  the  original  image  and  LM(i),  and 
reconstruct  an  image,  diffimaged),  from  this  difference 

(6)  Calculate  imaged)  -  imaged)  +  (3  *  diffimagefi )  where  /3  is  a  feedback,  coefficient  between 
0  and  1 

(7)  Increment  i  for  the  next  iteration,  and  go  to  step  3 

By  choosing  an  appropriate  value  for  0,  it  is  possible  to  gradually  converge  towards  an 
improved  silhouette  image  reconstruction. 

5.2.  Results 

A  series  of  silhouette  images  were  reconstructed  from  moment  sets  of  various  orders: 
Figures  5.1  to  5.3  show  reconstruction  attempts  for  a  top  view  of  the  BQM-34  Drone  model, 
using  complete  moment  sets  of  order  4,  6,  and  12.  These  represent  reconstructions  using  15, 
21,  and  91  numbers,  respectively.  The  image  size  used  is  64  by  64,  so  this  can  be  viewed  as  an 
attempt  to  recreate  the  original  image  using  from  a  273  to  1  to  a  45  to  1  compression  of  the 
original  data  set.  Figure  5.4  shows  a  graph  of  the  pixel  based  error  reduction  accorded  by  the 
iterative  technique  applied  to  the  BQM-34  image. 

Figures  5.1  through  5.3,  and  5J  through  5.9,  show  the  results  of  the  iterative  process  on 
image  reconstruction.  The  upper  left  corner  image  in  all  these  figures  is  the  original  silhouette 
image.  Directly  below  that  is  the  reconstruction  using  Teague’s  method  directly,  and  then  the 
lower  left  image  is  the  result  after  250  iterations  of  the  reconstruction  algorithm.  The  right 
side  of  these  figures  show  the  result  of  successive  iterations,  with  Teague’s  reconstruction  first, 
and  then  the  first  31  iterations  following.  The  progression  is  from  top  to  bottom,  and  then  left 
to  right.  These  figures  are  intended  to  give  both  a  visual  illustration  of  the  change  the  itera- 


tions  produce  in  the  original  reconstruction  attempt,  and  also  an  appreciation  of  the  rate  of 
change  with  different  feedbacks  and  moment  set  ordera 

Examination  of  figure  5.4  shows  that,  even  though  the  result  for  250  iterations  is  a  more 
asthetically  appealing  approximation  of  the  original,  for  moment  sets  of  order  4  and  6  the 
absolute  pixel  error  is  not  improved.  Dramatic  improvement  is  evident  for  an  order  12  recon¬ 
struction.  As  a  comparison  case,  figure  5.10  shows  the  same  graph  for  the  MiG  aircraft  The 
MiG  represents  a  fundamentally  simpler  geometric  shape  than  the  drone,  and  the  reconstruc¬ 
tion  statistics  reflect  this  fact  with  both  order  6  and  12  producing  improved  results.  An  order 
4  moment  set  still  shows  increasing  pixel  error  for  our  reconstruction  attempts. 

Figures  5J  through  5.8  show  reconstructions  of  two  simple  geometric  shapes  .  Figures 
5.5,  5.6,  and  5.7  show,  respectively,  the  results  for  reconstruction  of  a  small  rectangle  using 
order  4,  6,  and  12  moment  sets.  It  is  significant  that  for  this  simple  shape  even  an  order  4 
moment  *et  gives  an  excellent  reconstruction  after  a  few  iterations.  The  iterative  procedure 
can  also  use  a  comparitively  high  level  of  feedback,  without  loss  of  stability.  Figure  5.8  shows 
an  order  12  reconstruction  of  a  hollow  rectangular  shape.  For  this  case  very  low  feedback 
was  used  to  maintain  stability  of  the  iterations,  but  the  reconstructed  result  is  very  accurate, 
despite  a  slight  increase  in  complexity  over  the  basic  rectangle. 

Figure  5.9  shows  an  order  12  reconstruction  of  a  MiG-type  aircraft.  The  reduced  angu¬ 
larity  of  the  MiG,  as  compared  to  the  drone,  produces  a  visually  more  representative  recon¬ 
struction  at  both  low  and  high  numbers  of  iterations.  Figure  5.10  is  a  graph  of  absolute  pixel 
error  for  the  MiG,  based  on  order  4,  6,  and  12  reconstructions.  Unlike  the  drone,  the  MiG 
shows  improvement  for  an  order  6  moment  set  reconstruction,  as  well  as  for  order  12.  The 
order  4  moment  set  reconstruction  still  produces  increased  error  for  iterative  attempts  at 
improvement 

The  iterations  can  become  unstable  with  too  large  a  value  of  0  (feedback).  Conse¬ 
quently,  it  was  necessary  to  select  a  value  for  the  feedback  that  would  encourage  quick  con¬ 
vergence,  while  remaining  stable.  For  the  cases  given  her*,  the  simple  rectangle  used 


Figure  5.2. 

An  order  6  moment  set  reconstruction  of  the  BQM-34  drone.  The  final  result  after  250 
iterations  appears  more  representative  of  the  original  than  the  first  attempt,  but  in  real¬ 
ity  the  pixel  error  rate  is  higher.  Note  the  slow  rate  of  change  of  the  iterative  recon¬ 
struction  attempts  with  a  feedback  of  only  2%  to  maintain  stability. 


Figure  5.7. 

Reconstruction  of  the  small  rectangle  from  a  moment  set  of  order  4.  The  results  after  20 
iterations  are  very  comparable  for  the  three  different  moment  set  order  reconstructions 
of  the  small  rectangle,  all  showing  the  basic  shape  and  aspect  ratio. 


Figure  5.8. 

The  reconstruction  of  a  more  complex  geometric  shape.  This  hollow  rectangle  was  pro¬ 
duced  from  an  order  12  moment  set  An  order  of  magnitude  lea  feedback  than  for  the 
small  rectangle  was  used  for  this  reconstruction.  Higher  feedback  produced  much  faster 
shape  change  in  the  iterations,  but  the  final  result  after  250  iterations  was  inferior  to 
that  shown. 
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Figure  5.9. 

An  order  12  moment  set  reconstruction  of  the  MiG-type  aircraft  The  shape  is  simpler 
than  the  drone  example,  which  seems  to  produce  improved  results.  The  MiG  also  con¬ 
tains  more  object  pixels  than  the  drone,  which  allows  for  more  effective  image  perturba¬ 
tion  by  the  iterative  technique.  It  is  significant  to  note  that  even  Teague’s  initial  try 
with  this  image  produces  a  recognizable  result 
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Figure  5.10. 

This  graph  shows  the  results  of  iterative  reconstructions  of  the  MiG  from  moment  sets  of 
order  4,  6,  and  IX  Thaos  oorrsepond  to,  respectively,  the  top,  middle,  and  bottom  curves 
at  iteration  250.  Note  that  the  order  6  moment  set  reconstruction  does  not  show 
improvement  until  after  about  ISO  iterations.  Fine  tuning  of  the  feedback  to  optimize 
results  for  a  given  order  moment  set  might  improve  these  results. 
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0  *  0.25,  the  hollow  rectangle  used  0  *  0.05,  and  the  BQM-34  had  0  =  0.02.  The  MiG  used 
0  »  (X25  for  figure  5.9,  and  0  *  0.02  for  the  graph  in  figure  5.10.  As  can  be  seen,  the  more 
complex  and  convoluted  the  shape,  the  lower  the  feedback  used  for  stable  iterations.  Simi¬ 
larly,  the  feedback  must  be  reduced,  to  maintain  stability,  as  the  order  of  the  moment  set  used 
in  the  reconstrucion  is  decreased. 

An  additional  operation  was  added  to  the  basic  algorithm  that  enhanced  the  results;  par¬ 
ticularly  for  the  rectangular  shapes.  The  procedure  was  to,  effectively,  zero  a  border  region 
along  the  perimeter  of  the  image  in  each  reconstruction  attempt  This  implies  some  a  priori 
knowledge  of  the  object’s  dimensions;  but  far  a  small  border,  this  is  not  too  radical  an 
approach.  Removing  spurious  reconstructed  areas  along  the  image’s  edges  was  found  to 
improve  the  algorithm’s  behavior. 

A  further  modification  to  the  original  algorithm  also  allowed  a  feedback  decay.  The 
decay  term  is  a  value  between  0  and  1  that  the  feedback  is  multiplied  by  after  each  iteration, 
thus  the  original  algorithm  can  be  modified  by: 

(6a)  Reduce  feedback  as  0  *  a*  0,  where  a  is  a  constant  decay  term 

The  decay  factor  can  be  used  to  reduce  a  potentially  unstable  feedback  level  before  it  begins 
to  oscillate.  This  allows  fast  change  for  early  iterations,  and  forces  eventual  convergence  to  a 
stable  image.  It  should  be  noted  that  the  running  sum  maintained  in  imaged)  has  the  effect  of 
reducing  the  effect  of  each  succeeding  iteration's  feedback  image,  and  thus  there  is  an  implicit 
feedback  decay  in  the  algorithm.  The  decay  was  a  =  1.0  for  all  the  results  presented  here,  in 
an  effort  to  clearly  display  how  the  basic  approach  works,  without  the  added  obfuscation  of 
the  decay  coefficient. 

Tentative  attempts  at  image  reconstruction  using  a  moment  set  of  order  3  (10  numbers) 
indicated  that  it  was  virtually  impossible  to  obtain  stable  iterations.  For  this  reason,  order  4 
was  selected  as  the  lowest  suitable  order  for  our  reconstruction  attempts.  This  points  out  the 
correlation  between  stability  of  the  iterative  reconstruction  approach,  and  the  size  of  the  com- 


plete  moment  set  used. 


5.3.  Conclusions  on  Image  Reconstruction  from  Moments 

The  basic  approach  suggested  by  Teague  [4]  is  inadequate  to  deal  with  silhouette  imagery. 
The  iterative  feedback,  scheme  developed  here  yields  substantially  improved  results  over  the 
basic  method.  The  complexity  of  the  original  silhouette  dictates  the  success  of  the  technique, 
as  does  the  order  of  the  complete  moment  set  utilized  in  the  reconstruction  attempt. 

The  results  for  simple  geometric  shapes  indicate  that  moment  sets  as  small  as  order  4 
may  produce  good  reconstructions.  More  complex  figures  require  a  larger  moment  set,  and 
some  objects  are  difficult  to  reconstruct  even  with  a  moment  set  of  order  12.  The  iterative 
technique  also  may  tend  to  diverge  from  the  original  image  for  low  order  moment  sets. 

The  number  of  pixels  in  the  original  object  has  a  bearing  on  the  success  of  the  recon¬ 
struction.  The  fewer  the  pixels  in  the  original  object,  the  greater  the  sensitivity  of  the 
moments  to  slight  pixel  changes.  Thus  it  is  harder  to  produce  stable  iterations  for  a  small 
object  than  for  a  large.  This  effect  may,  in  some  cases,  explain  why  simpler  geometric  shapes 
are  more  accurately  reconstructed  than  more  complex,  convoluted  shapes.  Part  of  the  prob¬ 
lem,  though,  is  that  sharp,  angular  silhouette  changes  are  difficult  to  simulate  with  relatively 
low  order  polynomial  approximations. 

For  the  specific  object  examples  reported  here,  the  discussed  conclusions  are  unilaterally 
verified.  All  objects  showed  their  best  results  for  order  12  moment  set  reconstructions,  and 
then  reduced  performance  for  lower  order  attempts.  Complex  geometric  objects  required 
lower  feedback  than  their  simpler  counterparts,  to  produce  stable  iterations  that  would  result 
in  an  improved  image  reconstruction.  And  finally,  the  use  of  the  ancillary  technique  of 
border  zeroing  in  some  cases  significantly  enhances  the  results. 

A  reconstructive  method  may  prove  very  important  for  gaining  insight  into  moment 
classification  ambiguities,  since  it  gives  an  indication  of  both  the  significant  features  of  the 
image  being  classified,  and  the  sensitivity  of  the  reconstruction  to  moment  value  variation. 


6.  Overview  and  Conclusions 

This  report  has  considered  various  aspect  of  silhouette  moments.  The  common  thread 
concerns  their  effectiveness  for  the  identification  of  three  dimensional  objects.  At  one  extreme 
we  have  considered  their  suitability  for  classification  of  airplane  silhouettes,  and  at  the  other 
we  examined  reconstructing  an  image  from  the  very  limited  data  set  provided  by  its  moments. 

For  the  multiview  airplane  classification  task  reported  in  [8],  a  standard  moment  set  with 
the  specialized  normalizations  for  aspect  ratio  and  elemental  variance  showed  performance  far 
superior  to  Fourier  descriptors  and  more  classical  moment  invariant  based  approaches.  These 
results  held  for  both  noisy  and  clean  imagery.  Furthermore,  most  objects  could  be  identified 
with  an  order  3  moment  set,  and  only  a  small  increase  in  success  was  seen  for  the  data  set  of 
section  2  when  a  higher  order  moment  set  was  used. 

The  exhaustive  test  set  of  section  4  showed  improvement  when  higher  order  moment 
sets  were  used.  However,  the  best  results  occurred  for  order  J  moment  sets;  and  only  a  slight 
increase  in  success  was  observed  over  order  3.  The  results  for  airplane  identification  using 
various  subsets  of  the  standard  moment  set  indicated  that  odd  order  moments  were  more 
important  than  even  order  moments  for  classification  purposes.  A  complete  moment  set  of  a 
order  5  still  gave  the  best  results,  but  a  significant  number  of  moment  values  could  be  elim¬ 
inated  by  removing  the  order  4  moments,  with  only  a  slight  degradation  in  classifier  perfor¬ 
mance. 


Section  3  considered  noise  reduction  by  image  averaging.  Both  real  FLIR  data  and  syn¬ 
thetic  data  were  used  in  the  experimentation.  The  results  indicate  that,  in  situations  where 
objects  must  be  relocated  within  the  image  to  achieve  alignment  for  averaging  purposes, 
averaging  in  the  moment  domain  could  produce  better  results  than  greylevel  averaging  in  the 
image  domain.  Even  in  situations  where  the  moment  averaging  provided  similar,  or  even 
slightly  inferior  results,  the  tremendous  computational  simplification  of  object  relocation  in 
the  moment  domain  still  makes  the  technique  attractive. 
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The  final  topic  considered  was  silhouette  reconstruction  from  a  moment  set.  For  this 
purpose  Legendre  moments  were  used,  their  orthogonal  properties  proving  beneficial.  An 
iterative  reconstruction  scheme  using  error  feedback,  was  developed,  and  results  were  shown 
for  several  images  of  varying  size  and  complexity.  It  was  found  that  reconstruction  success 
was  determined  by  the  level  of  emr  feedback  used,  the  order  of  the  complete  moment  set 
used,  and  the  composition  of  the  original  image.  For  some  objects,  such  as  a  simple  rectangle, 
the  method  was  very  successful,  and  for  others,  such  as  the  BQM-34  drone  model,  little  suc¬ 
cess  was  realized  regardless  of  the  parameters. 

The  ease  of  calculation  of  the  moments  of  an  image  of  an  object,  and  the  mathematical 
tractability  of  many  operations  such  as  scaling  and  translation  in  the  moment  domain  com¬ 
mend  the  use  of  moments  for  object  identification  tasks.  The  results  presented  in  this  report 
further  endorse  the  use  of  moments  by  showing  the  potential  accuracy  of  object  identifications 
from  very  small  moment-based  feature  vectors. 
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ABSTRACT 

A  procedure  for  using  moment  bated  feature 
vectors  to  identify  a  three-dimensional  object  from 
a  two-diaaneional  image  recorded  at  an  arbitrary 
viewing  angle  end  range  is  presented.  Two  global 
technique*  which  hare  been  previously  proposed  for 
this  task  ara  Momenta  end  Fourier  descriptors. 
Yearly  all  the  research  in  moments  has  centered  on 
moment  invariants:  in  this  paper  we  ara  concarnad 
with  a  different  nomenc  form  called  standard 
moments .  He  have  used  a  standardised  sin  airplane 
experiment  in  order  to  compare  .different  tech¬ 
niques.  Fourier  deecriptors<  as  seed  by  Vallaca 
and  Hints,  and  moment  invariants  have  bean  compared 
with  our  ova  schema  for  normalised  moments.  Vari¬ 
ous  experiments  have  been  conducted  using  mixtures 
of  silhouette  and  boundary  moments  and  different 
normalisation  techniques.  Standard  moments  gave 
slightly  better  results  than  Fourier  descriptors 
far  this  experiment:  both  of  thesa  techniques  were 
much  better  then  moment  invariants. 


iniBocpcnoH 


Xhn  Six  Aim  lens  Experiment 

A  standardised  six  airplane  elsesif icetion 
taek  was  used  for  all  experiments.  It  ie  loosely 
beeed  on  so  experiment  designed  end  developed  by 
Hellace  and  Hints  Cl I.  Their  experiment  vis,  in 
turn,  looealy  based  on  the  experiment  conducted  by 
Dudaai  at. el.  C3]. 

The  kaeic  six  eirplena  experiment  ie  ee  fol* 
love.  The  sis  airplanes  are  described  by  a  short 
list  of  paremetere.  These  peraaatara  are  used  to 
gaoerate  s  repraeantacion  of  the  three  dimensional 
surfaca  of  an  airplane  consiating  of  a  sat  of  three 
and  four  sidad  polygons.  A  library  of  faatura  vec¬ 
tor  sets  af  two  dimensional  vievs  for  each  airplane 
it  generated.  Library  temples  ere  usually  taken 
over  a  uniform  grid  of  viewing  angles.  lech 
library  entry  ie  normalised  with  respect  to  else, 
location,  and  in-plaae  rotation. 

A  sat  of  random  vitvs  of  tbn  sis  airplanes  is 
naad  to  gasaraeo  s  test  set  of  feature  rector*. 
Each  test  view  i*  matched  by  naans  of  nearest 
luclidian  neighbor  is  feature  epace  to  ice  closest 
entry  in  tbn  library.  The  class  of  this  entry  is 
need  to  identify  tha  test  airplane.  The  perfor¬ 
mance  of  the  shape  analysis  schema  is  indicated  by 
the  number  of  correct  classifications. 


The  properties  of  uossoti  and  Fourier  descrip¬ 
tors  bare  been  examined  by  tba  use  of  an  experiment 
involving  six  airplane  sbspas  vievad  «  rsodoa 
angles  in  three  dimensions.  Fourier  descriptors  as 
used  by  Wallace  and  Hints  Cl]  bav*  been  compared 
vicb  our  own  scheme  C2]  for  normalised  moments. 
Moment  invariants  as  used  by  Dudsni  *t.  *1.  C3]> 
have  alao  been  considered.  Many  different  normal¬ 
ised  moment  forma  have  beta  proposed  Cl]  including 
Legendre  moments  sod  variants  of  moment  invariants 
C  A  3 .  In  this  paper  cb*  performance*  of  several 
normalisation  techniques  are  compared. 

Most  of  tha  previous  work  with  moments,  such 
as  tnat  by  Dudsni  et  si.  C3],  has  centered  on 
moment  invariants;  w*  have  concentrated  our  efforts 
on  normalised  conventional  moments  which  we  con¬ 
sider  to  be  less  sensitive  to  noise.  Normalisation 
procedures  for  standard  moments  are  described  in 
C5].  A  new  normalisation  technique,  aspect  ratio 
normalisation,  it  described  in  this  paper.  Fourier 
descriptors  of  the  contour  of  a  ahaps  may  ba  used 
in  s  similar  way  as  moments  to  identify  objects  ; 
C 6 ]  the  method  used  in  our  experiments  it  fully 
described  in  Cl].  The  moment  invariants  used  in 
our  experiment  ate  similer  to  thoee  need  by  Cudeni 
except  that  the  range  tn  the  object  is  not  known. 


MOMENT  PEA TUNE  VECTORS 

Tb*  conventional  definition  of  the  tvo- 
dioeneional  moment  of  order  (p*q)  of  a  function 
f(x.y)  is 


M  *  J  J  xpyqf(*,y)  ds  dv 
PR  -oo  -oo 


pt<)  3  0|1(2|  ee*  (1} 

A  t«c  of  moment  values  as  y  be  used  to 

represent  •  segment  of  an  image.  Operations  such 

as  rotatioo.  translation  and  scale  change  may  more 
easily  be  achieved  in  the  aooenc  domain  chan  the 
original  pixel  domain.  Furthermore,  a  truncated 
set  of  moments  nay  offer  a  aore  convenient  and 
economical  representation  of  the  essential  shape 
cnaraceeristica  of  an  image  segmeoc  than  a  pixel 
baaed  representation. 

Recent  work  C  5 1  has  shown  that  both  the 
moments  of  the  binary  silhouette  and  the  jrey- 

valued  image  segment  may  be  used  together  for  clas~ 
sification.  Furthermore.  the  two  dimensional 
moments  may  be  used  to  obtain  aomeota  of  projec¬ 

tions  through  the  image  segment  vnicb  say.  in  turn, 
be  used  in  class  if ication  senemes. 
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XfmiliH  KmmbM 

A  nt  « f  standard  moments  i«  *  CMS  wbicb  has 
bin  normalised  with  respect  to  scale,  translation, 
rotation  and  optionally  reflection.  Tbe  low  order 
standard  sonants  have  the  following  values: 

«  l  (area  normalized  to  1) 

■  0  (caatral  moments,  taken  aboue 

Mjj  *  0  tbe  canter  of  gravity) 

Mjj  »  0  (rotatioo  normalization;  ooneocs  are 
‘  taken  about  tbe  principal  asas) 

For  rotation  normalixaf loo  ve  also  have 

**20  *  *2 

If  r JXLllL  oorsa lisation  is  selected 

**03  *  0 

The  standard  sonant  representation  ef  a  seg¬ 
ment  is  vary  convenient  for  shape  analysis  and  nay 
be  conpared  directly  vitb  other  standard  none  it 
sets  for  shape  similarity. 

Asnact  tar  in  Harmalizaciau 

A  feature  of  the  standard  nonents.  as 
described  in  the  previous  section,  is  that  for 
blob-like  objects  tbe  magnitude  of  the  moments  vill 
decrease  ss  tbe  order  increases.  The  condition  for 
diminishing  magnitudes  is  that  the  object  be  con¬ 
fined  vitb in  a  2x2  square  centered  ac  the  origin. 
Recall  that  Mgg.  the  object  area,  is  1.  therefore 
all  other  momenta  vill  be  less  than  1.  If  any  part 
of  the  object  eataods  beyond  tbis  square  region, 

then  some  moments  vill  become  increasingly  large 
and  even  for  low  orders  may  be  much  larger  than  1. 
A  significant  number  of  tbe  airplane  library  images 
extend  beyond  tbe  2x2  square. 

In  order  to  improve  tbe  bebavior  of  feature 

vectors,  an  Aspect  ratio  normalization  was- 
developad.  This  is  a  projective  transform  of  sa 
image  of  the  object  which  converts  the  ellipsoid  ef 
inertia  of  the  object  to  a  circle,  i.e..  M,.  *  M... 
while  maintaining  M...  a  1.  There  are  still  shapes 
which  would  extend  Beyond  the  2x2  square  eves  after 
this  normalization;  however,  all  of  tbe  airplane 
images  vers  contained  in  this  square. 

A  change  in  scale  by  a  factor  of  8  in  the  x 
direction  and  V  in  tbe  y  direction  is  given  by: 

y1**1  K  (2) 

Pd  Pd 

Pqr  aspect  normalization  the  area  remains  1,  and 

**20  *  **02  ttal,f°r,‘ 

8  •  CMgj/Mjg)0-25.  y  *  1/8  (3) 

This  transformation  is  applied  to  standard 
moments.  for  the  transformed  moments,  Mj.  >  H-,, 
tnerefore  ve  discard  one  of  them.  The  aspect  ratio 
8  is  aa  important  sbape  feature  and  is  used  as  .the 
first  or  most  significant  feature  element.  Its 
value  is  in  cbe  range  0 <6S1 . 

CTASsmcATTOH  (mSBBBES 

Each  airplane,  considered  from  all  possible 
viewing  angles,  forms  s  continuous  surface  in 
feature  space.  Tbe  novel  clasavf icatiou  problem  is 
to  find  che  closest  airplaoe  surface  to  an  unknown 


airplane,  which  is  represented  by  a  single  point  in 
feature  space.  Classical  feature  vector  condition¬ 
ing  procedures,  such  as  tbe  Eigen  value  transforma¬ 
tion  aa  used  by  Wallace  and  Uintz,  are  oot  neces¬ 
sarily  appropriate  in  this  case  since  tbe  vitbin- 
class  feature  vector  variation  (for  all  different 
possible  viewing  angles)  is,  in  general,  less  than 
the  betveee-elaae  variation  for  a  given  viewing 
angle. 

Ve  have  used  two  classif icatioo  criterias. 
The  first  is  simply  minimum  Euclidian  distance  in 
feature  space,  goth  standard  moments  cod  normal¬ 
ized  Fourier  descriptors  have  feature  elements 
which  decrease  in  magnitude  with  order  or  fre¬ 
quency.  Therefore,  more  weight  is  placed  on  the 
lower  order  or  frequency  elaaeata  which  are 
expected  te  be  more  robust  with  respect  to  noise. 

The  second  criteria  is  minimum  Euclidian  dis¬ 
tance  after  "variance  balancing"  the  feature  vec¬ 
tors.  Variance  balancing  is  a  weighting  technique 
to  make  the  effect  of  tbe  feature  eleaMOts  more 
equal.  The  variance  of  each  feature  element  for 
all  featnre  vectors  in  tbe  total  library  for  all 
six  airplaaee  is  first  computed.  Then  all  feature 
elements  are  weighted  by  the  inverse  of  the  stan¬ 
dard  deviation  computed  for  the  library.  There¬ 
fore,  if  all  views  of  tbe  airplane  are  equally 
likely,  tbe  expected  variance  of  a  weighted  feature 
vector  ia  one. 

EimiMEHTS  MB  EE  STILTS 
Thu  Basic  Exnariwnnt 

The  followiog  parameters  vere  used  ia  che 
basic  esperimeet. 

(1)  The  library  view*  consisted  of  S00  views  uni¬ 
formly  sampled  over  the  total  sphere  of  viev- 
ing  angles.  lo  Dudani's  experiment  550  vieve 
of  each  airplane  were  taken  at  S  degree  inter¬ 
vale  in  s  140  by  90  degree  sector.  The 
library  views  used  by  Vsllacs  aad  Wincx  coo- 
tiattd  of  143  entries  covering  one  hemisphere 
in  a  11  s  13  grid. 

(2)  The  test  set  consisted  of  the  seme  $0  random 
views  of  azeb  sirplsne  for  s  total  set  size  of 
300.  The  viewing  angles  ustd  were  idaoticnl 
to  those  of  Wallace  end  Wiutz. 

(3)  Library  entries  were  computed  from  two* 
dimensional  views  digitized  on  e  12S  x  129 
piztl  uteris.  Test  set  enttiat  wen  also  com¬ 
puted  from  s  126  z  129  pixel  representation. 

Representative  views  of  escb  of  tbe  six  air¬ 
planes  with  e  128  s  12S  pixel  resolution  ere  shown 
is  Fig.  1.  Typical  random  views  of  these  airplanes 
are  sbown  ia  Fig  2.  A  noisy  version  of  tbe  test 
sat  of  airpleoee  vae  also  used  in  the  experiments. 

noiav  d&LA  gtntmifla 

Coosidsrsble  cars  was  takto  in  the  generation 
of  tbe  noisy  data  to  give  realistic  results.  The 
following  operations  were  applied  to  each  clean 
test  image. 

1.  The  silhouette  image  vat  converttd  to  a  grey 
level  image  in  which  each  object  point  is  3“ 
greater  then  the  background. 
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2.  A  2  s  2  local  Man  filter  operation  it  per* 
formed  which  bUra  the  edge*  ef  the  grey  level 

iaege. 

3.  Gants ian  noiae  ia  added  with  a  sean  of  aero 
and  a  atudard  deviation  of  30. 

4.  A  aecoad  2  t  2  local  mean  filter  operacioa  ia 
performed . 

5.  A  threaboldiog  operation  ia  perfoned  at  the 

optiaal  grey  level  for  Che  iMge  apecified  ia 
atop  1.  o 

6.  A  binary  filtering  algorithm  ia  applied  which 
aelecta  only  the  Min  connected  region  of  ooea 
(object  pointa)  in  the  image. 

Som  exaaplea  of  neiay  image*  are  given  ia  fig.  3. 

The  claaeif icatioa  result*  for  Fourier 
descriptors  are  shown  in  fig.  4.  for  Mall  numbers 
of  feature  vector  elemeoca  variance  balancing  ia 
beneficial  but  for  larger  number*  of  • lament*  the 
result*  are  worse.  The  results  for  clean  data  are 
slightly  better  than  those  obtained  by  Wallace  and 
tfiotz:  this  could  be  due  to  the  mure  dense  library 
which  we  used. 

The  elaaaif ieation  result*  for  conventional 
aoaeat a  and  aspect  ratio  normalised  noMnta  are 
•bovo  ia  fig.  S.  fnriuce  balancing  wake*  a  signi¬ 
ficant  improveMUt  in  the  results  for  clean  data  in 
both  cases.  The  best  results  are  obtained  with 
variance  balanced  aspect  ratio  normalised  soMSts. 
Thin  performance  is  effectively  achieved  with 
moment*  of  order  3j  using  more  moment  value*  baa 
vary  little  effect.  Variance  balancing  is  also 
very  important  for  the  noisy  data.  Thera  ia  a  sig¬ 
nificant  improvement  in  adding  aore  feature  vector 
el amen ta  ia  this  caae. 

fig  6.  show*  the  performance  ef  various  types 
of  feature  vector*  on  clou  data  using  variuca 
balancing.  Combining  silhouette  «*d  boundary  data 
did  give  a  slight  inproveMOt  over  the  silhouette 
decs  alone.  Momenta  besed  on  Legendre  polynomial* 
have  beam  proposed  by  Teague.  While  the  orthogonal 
property  night  be  espeeted  to  lead  to  better 
festntt  vector  representation*  our  results  indicate 
chat  they  performed  worse  than  the  silhouette 
mounts  from  which  they  were  derived.  »e wadary 
aoMnta  by  themselves  performed  much  worse  then 
silhouette  moment* . 

Also  shown  in  fig  6.  »*•  rssnlt*  for  moment 
invariants  which  are  worse  than  any  ether  technique 
tested.  These  wore  computed  in  a  similar  «y  to 
Oudani  accept  for  the  first  feature  aleMSt  value. 
Sudani  as*M*d  that  the  distance  to  the  object  was 
known;  therefore  the  absolute  scale  of  the  object 
me*  also  known  sod  is  embodied  io  the  first  feature 
vector  element.  In  our  studio*  ve  have  ssstaed 
that  the  disease*  to  the  object  is  not  known.  In 
our  moment  invariants  the  radius  of  gyration  (the 
first  feature  elsMnt)  i*  »is*  norMlited  by  the 
perceived  area  of  the  object  Mgg  while  Dudaoi 
ignores  this  area  nomeot  value. 


cohclusiom 

The  following  summarizes  the  beat  results 


which  hava 

been  obtained  for 

tach  faatur*  vactor 

type: 

Pasture 

Z  Correctly  Classified 

Vector 

Standard 

Founar 

Length 

MomdCs 

Daacriptor* 

6 

93.0  (85.7) 

77  .7  (75.0) 

11 

93.3  (89.7) 

90.7  (  82.3) 

17 

93.3  (89.7) 

90.3  (  85.0) 

24 

92.7  (91.0) 

91.7  (85.6) 

Tbs  figure*  in  parenthesis  are  for  a  noisy  set  of 
unknowns,  for  moment  invariants  of  the  silhouette 
(7  feature  vectors)  the  highest  recognition  rat* 
wo*  68.02  for  clean  data  and  69.32  for  noisy  data. 
Adding  boundary  moment  invariants  .  gave  worse 
results.  Tb*  above  result*  indicate  that  tharo  is 
vary  littl*  difference  between  the  performance  of 
Fourier  descriptor*  and  standard  moment*  for  this 
cask;  both  do  very  well.  Moment  invariants  did 
considerably  worse  than  the  other  techniques.  Ib* 
Mtbod  used  for  normalization  significantly  affects, 
the  results.  In  general,  the  addition  of  boundary 
moMots  did  not  improve  the  classification  result* 
for  a  given  number  of  feature  vector*  and  boundary 
msMOts  by  tbMselves  were  not  very  good. 
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